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Event-driven  replanning  is  a  dynamic  process  that  adjusts  plans  in 
progress  in  response  to  unanticipated  events.  When  an  unanticipated  event 
occurs,  it  disrupts  the  plan  in  progress  by  creating  new  demands  with 
accompanying  constraints  that  must  be  satisfied.  The  task  becomes  a  constraint 
satisfaction  problem  that  sometimes  requires  planners  to  negotiate  to  manage  or 
relax  constraints  while  they  shuffle  and  reallocate  resources  that  are  already 
committed  as  part  of  the  plan  in  progress.  Revising  the  allocation  and 
distribution  of  these  resources  changes  the  plan  in  progress  and  causes 
secondary  disruptions  with  accompanying  constraints.  The  types  of  secondary 
disruptions  that  occur  are  dependent  on  the  resources  that  are  revised.  Each 
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resource  that  is  altered  will  create  different  side  effects  that  can  ripple 
throughout  the  plan  in  progress  and  jeopardize  future  activities. 

The  purpose  of  this  research  was  to  understand  the  strategies  that  people 
use  in  the  event-driven  replanning  process.  The  crux  of  the  study  centered 
around  three  directly  observed  cases  of  practitioners  actually  engaged  in  the 
event-driven  replanning  process  in  aeromedical  evacuation.  An  in  depth 
protocol  analysis  was  performed  on  each  of  the  three  cases. 

The  results  showed  that  constraints  drive  the  event-driven  replanning 
process.  Plaimers  use  multiple  strategies  to  identify  and  manage  constraints  to 
devise  successful  plans.  Planners  utilize  a  primarily  depth  first  approach  to  plan 
development.  They  rely  on  recognition,  using  a  case-based  strategy  which  is 
augmented  with  opportunistic  and  hierarchical  planning  strategies.  Planners 
also  rely  heavily  on  their  ability  to  negotiate  to  manage  or  relax  constraints 
dttring  the  event-driven  replanning  process.  A  surprising  result  was  that 
planners  did  not  consider  minimizing  secondary  disruptions  as  a  part  of  their 
planning  strategy.  Instead,  they  concentrated  on  accommodating  the  primary 
disrupting  event  and  opted  to  manage  the  secondary  disruptions  that  might 
ensue  The  results  of  this  research  can  be  used  to  design  more  effective 
automated  tools  to  support  the  complex  event-driven  replanning  process. 


2 


THE  COGNITIVE  COMPLEXITY  OF  EVENT-DRIVEN  REPLANNING: 
MANAGING  CASCADING  SECONDARY  DISRUPTIONS 
IN  AEROMEDICAL  EVACUATION  PLANNING 


By 

Marie  E.  Walters,  Ph.D. 

The  Ohio  State  University,  1996 
Professor  David  D.  Woods,  Adviser 


Event-driven  replanning  is  a  dynamic  process  that  adjusts  plans  in 
progress  in  response  to  unanticipated  events.  When  an  unanticipated  event 
occurs,  it  disrupts  the  plan  in  progress  by  creating  new  demands  with 
accompanying  constraints  that  must  be  satisfied.  The  task  becomes  a  constraint 
satisfaction  problem  that  sometimes  requires  planners  to  negotiate  to  manage  or 
relax  constraints  while  they  shuffle  and  reallocate  resoiuces  that  are  already 
committed  as  part  of  the  plan  in  progress.  Revising  the  allocation  and 
distribution  of  these  resources  changes  the  plan  in  progress  and  causes 
secondary  disruptions  with  accompanying  constraints.  The  types  of  secondary 
disruptions  that  occur  are  dependent  on  the  resources  that  are  revised.  Each 


1 


resource  that  is  altered  will  create  different  side  effects  that  can  ripple 
throughout  the  plan  in  progress  and  jeopardize  future  activities. 

The  purpose  of  this  research  was  to  understand  the  strategies  that  people 
use  in  the  event-driven  replanning  process.  The  crux  of  the  study  centered 
aroxind  three  directly  observed  cases  of  practitioners  actually  engaged  in  the 
event-driven  replanning  process  in  aeromedical  evacuation.  An  in  depth 
protocol  analysis  was  performed  on  each  of  the  three  cases. 

The  results  showed  that  constraints  drive  the  event-driven  replanning 
process.  Planners  use  multiple  strategies  to  identify  and  manage  constraints  to 
devise  successful  plans.  Plaimers  utilize  a  primarily  depth  first  approach  to  plan 
development  They  rely  on  recognition,  using  a  case-based  strategy  which  is 
augmented  with  opportunistic  and  hierarchical  planning  strategies.  Planners 
also  rely  heavily  on  their  ability  to  negotiate  to  manage  or  relax  constraints 
during  the  event-driven  replanning  process.  A  surprising  result  was  that 
plaimers  did  not  consider  minimizing  secondary  disruptions  as  a  part  of  their 
planning  strategy.  Instead,  they  concentrated  on  accommodating  the  primary 
disrupting  event  and  opted  to  manage  the  secondary  disruptions  that  might 
ensue  The  results  of  this  research  can  be  used  to  design  more  effective 
automated  tools  to  support  the  complex  event-driven  replanning  process. 


2 


12/20/96  16:58  FAX 


IGNITION 


ilOOl 


IHE  COGNTTIVE  COMPLEXTIY  OF  EVENT-DRIVEN  REPLANNING; 
MANAGING  CASCADING  SECONDARY  DISRUPTIONS 
IN  AEROMEDICAL  EVACUATION  PLANNING 


DISSERTATION 


Presented  in  Partial  Fulfillment  of  the  Requirements  for 
the  Degree  Doctor  of  Philosophy  in  the  Graduate 
School  of  the  Ohio  State  University 


By 

Marie  E.  Walters,  M.S. 


The  Ohio  State  University 
1996 


Dissertation  Committee: 

Professor  David  D.  Woods,  Adviser 
Professor  Philip  Smith 
Professor  Jane  Fraser 


Approved  by 


Industrial  Systems  Engineering 
Graduate  Program 


ABSTRACT 


Event-driven  replanning  is  a  dynamic  process  that  adjusts  plans  in 
progress  in  response  to  unanticipated  events.  When  an  unanticipated  event 
occtirs,  it  disrupts  the  plan  in  progress  by  creating  new  demands  with 
accompanying  constraints  that  must  be  satisfied.  The  task  becomes  a  constraint 
satisfaction  problem  that  sometimes  requires  planners  to  negotiate  to  manage  or 
relax  constraints  while  they  shuffle  and  reallocate  resources  that  are  already 
committed  as  part  of  the  plan  in  progress.  Revising  the  allocation  and 
distribution  of  these  resources  changes  the  plan  in  progress  and  causes 
secondary  disruptions  with  accompanying  constraints.  The  types  of  secondary 
disruptions  that  occm  are  dependent  on  the  resources  that  are  revised.  Each 
resource  that  is  altered  will  create  different  side  effects  that  can  ripple 
throughout  the  plan  in  progress  and  jeopardize  future  activities. 

The  purpose  of  this  research  was  to  tmderstand  the  strategies  that  people 
use  in  the  event-driven  replanning  process.  The  crux  of  the  study  centered 
around  three  directly  observed  cases  of  practitioners  actually  engaged  in  the 
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event-driven  replanning  process  in  aeromedical  evacuation.  An  in  depth 
protocol  analysis  was  performed  on  each  of  the  three  cases. 

The  results  showed  that  constraints  drive  the  event-driven  replanning 
process.  Plaimers  use  multiple  strategies  to  identify  and  manage  constraints  to 
devise  successful  plans.  Planners  utilize  a  primarily  depth  first  approach  to  plan 
development.  They  rely  on  recognition,  using  a  case-based  strategy  which  is 
augmented  with  opportunistic  and  hierarchical  planning  strategies.  Plaimers 
also  rely  heavily  on  their  ability  to  negotiate  to  manage  or  relax  constraints 
during  the  event-driven  replanning  process.  A  surprising  result  was  that 
planners  did  not  consider  minimizing  secondary  disruptions  as  a  part  of  their 
planning  strategy.  Instead,  they  concentrated  on  accommodating  the  primary 
disrupting  event  and  opted  to  manage  the  secondary  disruptions  that  might 
ensue  The  results  of  this  research  can  be  used  to  design  more  effective 
automated  tools  to  support  the  complex  event-dr^en  replanning  process. 
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CHAPTER  1 


INTRODUCTION 


1.1  Overview 

Technology  has  spawned  automated  systems  that  schedule  and  plan 
complex  dynamic  processes  more  quickly  and  more  efficiently  then  ever  before. 
Sophisticated  algorithms  and  increased  computing  power  afford  more  effective 
and  efficient  utilization  of  resources,  increase  productivity,  and  ultimately 
sustain  system  complexity.  However,  what  happens  when  plans  are  in  motion, 
resources  are  committed,  scheduled  activities  are  underway,  and  an 
xmanticipated  event  occurs? 

Current  literature  on  plarming  falls  short  of  providing  an  answer  to  this 
question  that  will  sustain  planning  in  real  world,  complex  environments.  One  of 
the  primary  reasons  for  this  shortcoming  is  that  the  bulk  of  the  planning  research 
performed  in  the  past  focused  on  plan  generation;  i.e.  developing  a  plan  or 
scheduling  events  to  accomplish  some  future  activity. 

More  recently,  researchers  have  begun  to  delve  into  the  more  dynamic 
aspects  of  planning  where  plan  generation  and  plan  execution  coexist  Reactive 


planning  and  plan  repair  are  two  of  the  more  common  approaches  to  dynamic 
plaiming.  However,  the  environments  in  which  reactive  planning  models  are 
tested  have  been  sparse,  sedate,  and  void  of  any  real  world  complexity.  In 
addition,  although  recent  research  on  plan  repair  has  shown  promise,  the 
models  used  to  study  this  approach  continue  to  focus  on  static  information  and 
off-line  repairs.  As  such,  this  research  offers  a  different  approach  to 
understanding  planning  in  complex,  real  world  environments  by  studying  how 
people  replan  ongoing  activities  in  response  to  unanticipated  events. 

The  basis  for  the  current  research  was  an  ethnographic  study  of  the 
Department  of  Defense  Aeromedical  Evacuation  System.  The  study  was 
comprised  of  direct  observations  of  both  routine  and  critical  events,  interviews, 
and  retrospective  critical  incident  reports  that  were  collected  over  an  eighteen 
month  period.  The  crux  of  the  study  centers  around  three  directly  observed 
cases  of  practitioners  actually  engaged  in  the  event-driven  replanning  process. 
An  in  depth  protocol  analysis  was  performed  on  each  of  the  three  cases.  Results 
from  this  study,  coupled  with  previous  literature  on  planning  were  used  to 
answer  the  fundamental  question  of  this  research:  "How  do  people  adapt  plans 
in  progress  to  respond  to  unanticipated  events  in  complex,  dynamic 
environments"? 
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1.2  Description  of  Event-Driven  Replanning 

A  plan  is  underway  to  transport  ill  and  injured  military  patients  at 
various  locations  to  appropriate  medical  treatment  facilities  around  the  world. 
Medical  personnel,  flight  crews,  and  equipment  have  been  assembled  and 
dispatched  to  transport  these  patients.  While  operational  personnel  are 
monitoring  this  plan  in  progress,  a  new  requirement  emerges  to  provide 
immediate  transport  for  a  seriously  ill  patient  who  requires  emergency  medical 
treatment  in  another  state.  Multiple  players  collaborate  to  modify  the  plan  in 
progress  to  transport  the  urgent  patient  to  the  appropriate  medical  treatment 
facility.  A  plan  begins  to  take  shape  but  is  continually  revised  as  additional  data 
emerges  and  new  or  conflicting  constraints  arise.  Diverting  an  aircraft  to  pick 
up  the  urgent  patient  disrupts  the  itineraries  of  the  patients  on  board  and  those 
scheduled  to  be  picked  up  by  the  diverted  aircraft.  As  such,  not  only  must  a  plan 
be  generated  to  handle  the  unanticipated  event,  but  itineraries  for  disrupted 
patients  must  also  be  replanned  in  order  to  successfully  implement  the  overall 
revised  plan.  Later,  new  information  on  the  urgent  patient' s  status  indicates  a 
secondary  medical  condition  which  requires  special  in-transit  medical  care. 
Providing  this  care  wiU  significantly  delay  the  patienf  s  arrival  at  the  destination 
and  cause  additional  disruptions.  Numerous  participants  interact  to  manage 
these  issues  and  disruptions.  Mtdtiple  activities  and  tines  of  reasoning  emerge 
and  intertwine  as  the  situation  unfolds  and  new  information  comes  in  over  time. 
Issues  are  apparently  resolved  only  to  reemerge  as  new  data  arises.  A 
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distributed  process  of  discovering  and  accommodating  multiple  interacting 
constraints  takes  place  as  the  participants  collaborate  to  form  and  cany  out  a 
workable  revised  plan  in  real  time.  This  is  event-driven  replaiming. 

Event-driven  replanning  presupposes  a  detailed  existing  plan  or  schedule 
that  is  based  on  projections  of  future  demands  and  resources.  Event-driven 
replanning  is  a  dynamic  process  that  adjusts  plans  in  progress  in  response  to 
unanticipated  events  such  as  urgent  patient  movement  requests  or  unexpected 
loss  of  resources.  When  an  unanticipated  event  occxors,  it  disrupts  the  plan  in 
progress  by  creating  new  demands  with  accompanying  constraints  that  must  be 
satisfied.  The  task  becomes  a  constraint  satisfaction  problem  that  sometimes 
requires  planners  to  negotiate  to  manage  or  relax  constraints  while  they  shuffle 
and  reallocate  resources  that  are  already  committed  as  part  of  the  plan  in 
progress.  Revising  the  allocation  and  distribution  of  these  resoiuces  changes  the 
plan  in  progress  and  causes  secondary  disruptions  with  accompanying 
constraints.  The  types  of  secondary  disruptions  that  occur  are  dependent  on  the 
resources  that  are  revised.  Each  resource  that  is  altered  will  create  different  side 
effects  that  can  ripple  throughout  the  plan  in  progress  and  jeopardize  future 
activities.  These  side  effects  or  secondary  disruptions  throw  the  plan  out  of 
alignment  and  require  planners  to  repair  the  plan  and  subsequently  get  the 
revised  plan  back  on  track  (See  Figiure  1). 
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Figure  1.  Event  driven  replanning.  Disrupting  events  in  the  world  initiate  the 
event  driven  replanning  process.  The  response  to  a  disrupting  event  causes 
secondary  disruptions  that  ripple  throughout  the  plan  in  progress.  Planners 
must  manage  these  secondary  disruptions  and  develop  a  plan  to  minimize  their 
effects. 


Once  a  plan  is  in  motion;  that  is,  when  the  planned  for  activities  have 
commenced  and  resources  have  been  committed,  there  are  costs  associated  with 
changing  the  plan  and  "uncommitting"  those  resources.  The  cost  of  changing  a 
plan  in  motion  and  uncommitting  and  recommitting  resources  can  have  far 
reaching  effects.  Replanning  costs  time  and  effort  to  mission  planner,  it  costs 
money,  resources,  and  potentially  the  reputation  of  the  aeromedical  evacuation 
system,  it  costs  service  providers  time,  effort,  and  paperwork,  and  lastly  it  can 
affect  the  timeliness  of  patienT s  receiving  medical  treatment.  Carnegie  Group, 
Incorporated  uses  the  term  "Sliding  Scale  of  Commitment"  to  describe  the  costs 
associated  with  changing  plans  at  various  points  on  the  time  horizon.  The  closer 
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you  move  toward  the  present  time,  the  higher  the  level  of  commitment  of 
resources.  Ringer  (1992)  uses  a  physical  example  to  describe  the  planning 
process.  Imagine  a  planning  horizon  that  stretches  from  zero  to  100  where  to= 
Now  and  tioo=  Infinity.  The  closer  the  plaimed  for  activity  is  to  100,  the  more 
gaseous,  or  undefined  the  plan.  In  this  gaseous  state,  plans  can  be  changed  or 
reshaped  to  meet  the  changing  environment.  As  you  move  closer  to  to,  the  plan 
starts  to  become  more  viscous  and  displays  properties  that  make  it  more  difficult 
to  shape  or  contain.  At  to,  the  plan  is  a  solid,  has  its  own  definitive  structure  and 
changing  it  at  this  stage  requires  considerable  effort  To  avoid  the  costs 
associated  with  changing  the  plan  in  progress,  planners  try  to  devise  plans  to 
accommodate  the  initial  disrupting  event  but  leave  as  much  of  the  original  plan 
intact  as  possible. 

Event-driven  replanning  is  a  complex  process  that  requires  plaimers  to 
engage  in  real  time  problem  solving  to  deal  with  the  disrupting  event,  and  to 
project  and  manage  secondary  disruptions.  It  incorporates  the  cognitive 
elements  of  planning,  problem  solving,  mental  simulation,  disturbance 
management,  and  decision  making. 

1.3  Event-Driven  Planning  vs.  Other  Planning  Models 

There  are  several  factors  that  not  only  differentiate  event-driven 
replanning  from  other  planning  approaches,  but  also  create  significant 
challenges  for  designers  who  wish  to  automate  or  support  the  event-driven 
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replanning  process.  First,  the  focus  of  this  research  was  on  discovering  how 
people  perform  event-driven  replanning  in  complex,  dynamic  environments. 
Second,  this  study  looked  at  plans  in  motion  as  opposed  to  plan  generation  or 
static  plan  repair.  Not  only  is  the  world  in  which  the  plan  is  operating  dynamic 
and  ever  changing,  the  plan  itself  is  moving  and  progressing  to  achieve  multiple 
goals.  Third,  there  is  a  cost  of  commitment.  Event-driven  replanning  involves 
uncommitting  resources  that  have  been  previously  committed.  This  disrupts  the 
plan  in  progress  which  produces  secondary  disruptions  which  incur  associated 
costs.  Foirrth,  the  context  in  which  this  study  took  place  was  a  complex  dynamic 
environment  where  information  emerged  and  changed  over  time.  As  such,  the 
information  required  to  create  a  successful  plan  was  not  available  at  the  outset  of 
the  planning  process.  Information  trickles  in  over  time  altering  the  nature  of  the 
plan/ problem  at  hand.  In  typical  planning  models,  the  initial  state  is  specified 
and  the  goal  state  is  known.  The  role  of  the  plan  in  those  models  is  to  chart  a 
course  from  the  initial  state  to  the  goal  state.  In  event-driven  replanning 
however,  planners  are  required  to  commence  the  planning  process  imder 
conditions  where  the  initial  and  goal  states  may  be  unknown,  incomplete  or 
subject  to  change.  As  a  result,  operating  in  such  an  environment  requires 
substantial  adaptabihty,  flexibility,  and  process  knowledge  to  fiU  in  the  gaps 
when  data  is  incomplete  or  prone  to  changes. 

Currently,  computational  models  and  artificial  intelligence  methods  do 
not  possess  the  flexibUity  nor  the  adaptability  that  would  be  required  to  totally 
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automate  the  event-driven  replanning  process.  As  such,  the  event-driven 
replarming  is  a  process  that  should  be  supported,  but  not  automated. 

1.4  Purpose  of  flie  Research 

The  purpose  of  this  research  was  to  uncover  the  cognitive  demands  that 
event-driven  replanning  imposes  on  practitioners  and  to  understand  the 
cognitive  strategies  and  heuristics  that  they  employ  to  cope  with  those  demands. 
This  was  accomphshed  by  identifying  how  planners  in  the  Military  Aeromedical 
Evacuation  environment:  1)  limit  their  search  space  to  accommodate  new 
disrupting  events,  2)  evaluate  that  search  space  for  possible  secondary 
disruptions,  and  3)  preserve  plan  integrity  to  the  fullest  extent  in  the  face  of 
those  disruptions  (i.e.  keep  as  much  of  the  original  plan  intact  as  possible). 

The  information  in  this  report  is  based  on  direct  observations  of  three 
event-driven  replanning  incidents  in  the  aeromedical  evacuation  domain.  A 
protocol  analysis  was  used  to  identify  and  characterize  the  cognitive  demands 
and  strategies  of  event-driven  replanning  in  this  environment 

The  aeromedical  evacuation  environment  provided  a  natural  laboratory 
to  observe  the  event-driven  replanning  process  in  situ.  However,  the  results  of 
this  research  can  be  used  to  characterize  demands  and  strategies  in  other 
dynamic  planning  environments  such  as  job  shop  scheduling  and  airline 
dispatching  (Szelke  &  Markus,  1994;  Smith,  McCoy,  &  Layton,  1995).  The 


8 


knowledge  gained  from  this  research  will  provide  valuable  insight  for 
developing  aiding  strategies  to  support  this  complex  task. 

1.4  Overview  of  the  Paper 

To  facilitate  the  review  of  this  research,  the  dissertation  will  be  presented 
in  seven  chapters.  Chapter  2  presents  an  overview  of  the  research  related  to 
planning  and  replanning.  Chapter  3  describes  the  complexity  of  the 
aeromedical  evacuation  domain  and  introduces  the  environment  in  which  the 
observed  incidents  took  place.  It  also  includes  brief  descriptions  of  the  facility, 
the  players  involved,  and  the  cognitive  artifacts  utilized  to  perform  event-driven 
replanning.  Chapter  4  is  dedicated  to  methodological  issues.  It  includes  a 
description  of  the  data  collection  activities  and  venues,  the  methods  used  to 
collect  and  document  the  activities  of  the  cases  along  with  a  discussion  of  verbal 
reports  and  verbal  behavior.  This  chapter  concludes  with  a  description  of  the 
verbal  protocol  analysis  techniques  utilized  along  with  instructions  for 
understanding  the  structure  of  the  protocols.  Chapter  5  begins  with  a  discussion 
of  whv  the  cases  presented  in  this  research  were  selected  and  why  they  are 
worthy  of  close  examination,  written  overviews  of  each  event-driven  replanning 
incident  describing  the  context  in  which  the  incidents  took  place,  and  a  detailed 
description  of  the  nature  of  each  of  the  incidents.  This  chapter  also  provides 
complete  protocol  analyses  along  with  descriptions  of  the  interesting  results  of 
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each  of  the  event-driven  replanning  incidents.  Chapter  6  synthesizes  the  restdts 
from  each  of  the  even-driven  replanning  incidents  and  presents  conclusions  and 
implications  of  these  findings  for  cognitive  engineering  and  aiding  the  cognitive 
components  of  event-driven  replanning. 
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CHAPTER  2 


RELATED  RESEARCH 


2.1  Disturbance  vs.  Disruption  Management 

Managing  unanticipated  activities  or  abnormal  events  in  dynamic 
processes  imposes  cognitive  demands  on  persons  responsible  for  monitoring 
those  processes.  Disturbance  management  is  used  to  refer  to  the  procedure 
whereby  process  controllers  attempt  to  diagnose  a  problem  while  continuing  to 
maintain  safe  and  effective  process  function.  The  distinction  is  made  between  a 
disturbance  in  a  dynamic  physical  or  engineered  process  such  as  nuclear  power 
plant  operation  and  a  disruption  in  a  non-physical  process  such  as  aeromedical 
evacuation  planning.  Traditionally,  cognitive  systems  engineering  principles 
have  been  focused  on  dynamic  physical  processes.  Applying  these  principles  to 
envisioned,  non-physical  processes  is  a  neoteric  venture  for  the  field  of  cognitive 
systems  engineering. 

In  dynamic  physical  processes,  an  abnormal  event  typically  occurs  when 
some  component  fails  or  ceases  to  function  in  the  prescribed  manner  for  the 
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context  in  which  it  is  operating.  Typically,  when  a  fault  occurs,  system  failure  is 
not  immediate,  but  instead  system  performance  degrades  over  time.  The 
monitored  process  is  disturbed  in  that  it  continues  to  function  albeit  in  a 
degraded  state.  A  fault  in  a  dynamic  process  produces  a  cascade  of 
disturbances.  These  disturbances  are  the  side  effects  or  sources  of  influences 
resulting  from  the  initial  fault  (Woods,  1994).  Controllers  are  faced  with  the  task 
of  diagnosing  the  symptomatic  effects  in  order  to  uncover  the  root  cause  of  the 
problem.  Unfortunately,  a  particular  symptom  may  be  a  characteristic  of  many 
different  faults.  Disturbances  propagate  through  the  monitored  process  when 
systems  are  tightly  coupled.  The  more  the  components  or  the  activities  are 
interleaved  in  a  process,  the  greater  the  cascade  of  disturbances. 

In  dynamic  activities  that  are  not  characterized  by  physical  or  engineered 
processes,  such  as  event-driven  replanning  in  the  aeromedical  evacuation 
domain,  xmanticipated  events  tend  to  have  immediate  effects.  In  addition, 
diagnosis  does  not  come  into  play  because  the  origin  of  the  disruption  is 
immediately  apparent  Cascading  disruptions  and  coupling  result  as  multiple 
independent  path  problems  depend  on  and  contend  for  a  limited  set  of 
resources. 

Just  as  the  goal  of  disturbance  management  is  to  diagnose  the  fault  while 
preserving  system  integrity,  the  goal  of  disruption  management  is  to 
accommodate  the  unanticipated  event  while  preserving  as  much  of  the  plan  in 
progress  as  possible.  In  both  cases,  a  form  of  mental  simulation  and  hypothesis 
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generation  come  into  play  as  operators  and  planners  try  to  project  the  cascade  of 
disruptions  and  diagnose  the  disturbances  in  order  to  adequately  manage  the 
consequences  and  identify  the  fault,  respectively. 

2.2  Computational  Models 

The  field  of  artificial  intelligence  has  provided  tremendous  insights  into 
the  hidden  complexity  of  the  planning  process.  For  example,  computer  models 
that  attempt  to  generate  plans  to  move  robots  around  objects  in  dynamic 
environments  have  been  relatively  unsuccessful.  The  hidden  complexity  inherit 
in  designing  such  a  system,  as  with  all  computational  planning  models,  centers 
on  the  ability  to  keep  track  of  disruptions  that  follow  from  an  event  The 
dilemma  arises  from  the  conflicting  desires  to  develop  a  system  that  is  both 
robust  and  efficient  in  its  reasoning  about  the  future  (Shoham,  1987).  The 
following  computational  models  are  two  of  the  more  renowned  approaches  to 
plan  generation. 

2.2.1  Sacerdoti's  ABSTRIPS  Model 

ABSTRIPS  is  a  model  that  treats  the  planning  process  as  a  hierarchy  of 
abstraction  spaces.  The  abstractions  serve  as  a  means  to  discriminate  between 
elements  that  are  crucial  to  the  success  of  the  plan  and  elements  that  comprise 
the  details  that  may  become  critical  at  the  lower  levels  of  the  hierarchy.  The 
highest  level  of  abstraction  generates  a  complete  skeleton  plan  in  which 
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unimportant  details  are  not  included.  At  each  subsequent  level  of  abstraction, 
critical  details  are  maintained  and  incorporated  and  the  less  important  details 
are  bumped  down  to  lower  levels  of  the  hierarchy.  This  occurs  until  a  plan  is 
identified  that  incorporates  the  details  required  to  successfully  achieve  the  goal. 
If  a  plan  fails  at  one  level  of  abstraction,  the  planner  backtracks  up  the  hierarchy 
and  then  takes  a  different  path.  The  problem  solving  process  is  streamlined 
because  the  search  hexuistics  wiU  only  investigate  those  details  that  higher  levels 
identify  as  important 

2.2.2  Wilensky's  Planning  Model 

Wilensky's  approach  to  planning  recognizes  that  human  planning  is  a 
complex  process  composed  of  multiple  interacting  components.  Wilensky 
proposed  four  components  of  an  efficient  planner;  A  Goal  Detector,  A  Plan 
Proposer,  A  Projector,  and  an  Executor.  These  components  can  be  described  in 
cognitive  terms  such  as;  recognition,  situation  assessment,  mental  simulation, 
and  action  respectively.  Basically,  Wilensky  is  describing  an  elaboration  of  the 
perception-action  cycle. 

2.3  Cognitive  Models 

2.3.1  Hayes-Roth  &  Hayes-Roth's  Opportunistic  Model 

The  Opportunistic  Model  is  a  cognitive  model  of  planning.  Hayes-Roth  & 
Hayes-Roth  define  planning  as  "a  predetermination  of  a  course  of  action  aimed 


14 


at  achieving  some  goal".  They,  like  Sarcedoti,  also  beheve  that  planning  occurs 
at  mtdtiple  levels  of  abstraction.  They  extend  that  belief  by  adding  that  humans 
are  able  to  plan  at  multiple  levels  of  abstraction  simultaneously.  Humans  have 
the  abnity  to  recognize  opportunities  to  achieve  other  goals  while  planning  for  a 
particular  goal.  As  opportunities  are  recognized  the  plan  sequence  may  be 
altered  and  subsequently  affect  planning  at  any  level  of  abstraction.  Initial 
planning  abstractions  may  highlight  constraints  at  lower  levels  that  will  shift  the 
focus  of  attention  to  that  level.  Similarly,  lower  level  abstractions  may  uncover 
details  or  opportunities  that  suggest  an  alternative  higher  level  abstract  plan  to 
replace  the  original  plan.  As  such,  planning  is  a  heterarchical  process  that  can 
proceed  top  down,  bottom  up,  or  across  plan  dimensions.  This  allows  planners 
to  capitalize  on  relationships  in  the  environment  and  consequently  yield  more 
efficient  plans. 

2.3.2  Suchman's  Situated  Actions 

Suchman  (1987)  views  plans  as  resources  for  action.  She  states,  that 
"While  plans  presuppose  the  embodied  practices  and  changing  circumstances  of 
situated  action,  the  efficiency  of  plans  as  representations  comes  precisely  from 
the  fact  that  they  do  not  represent  those  practices  and  circumstances  in  all  of 
their  concrete  detail"  (p.  52).  What  differentiates  plan  generation  from  event- 
driven  planning  is  that  the  former  deals  with  anticipating  future  activities  while 
the  latter  deals  with  reacting  to  situations  cturently  occurring  in  the  world. 


15 


Regardless  of  how  successful  a  planner  is  at  anticipating  future  activities,  it 
would  be  impossible  to  predict  and  plan,  in  detail,  for  every  possible  outcome. 
As  such,  plans  are  inherently  incomplete.  Wilensky  makes  a  similar  point  in  the 
following  statement  "...plans  are  continually  revised  in  response  to  detected 
flaws  and  changes  in  the  environment.  In  fact,  since  the  planner  is  in  principle 
detecting  new  goals  all  the  time,  the  idea  of  a  completed  plan  is  only  a  relative 
notion"  (Wilensky,  1983  p.  17). 

2.3.3  Hammond's  Case-Based  Planning  and  Plan  Repair 

Case-based  planning  is  based  on  the  notion  that  planning  is  primarily  a 
memory  task.  Case-based  reasoning  posits  that  people  rely  on  past  experiences 
to  guide  their  actions  in  present  situations.  Human  planning  is  case-based  in 
that  people  use  plans  in  memory  as  starting  points  to  guide  new  planning 
activities  (Hammond,  1990).  As  such,  people  never  devise  a  plan  from  scratch. 
They  always  base  a  new  plan  on  an  old  plan  that  has  at  least  marginal 
similarities  to  the  situation  at  hand. 

Case  based  planners  use  knowledge  of  the  world  and  effects  of  actions  to 
assess  a  situation.  They  make  use  of  memory  (past  experiences)  whenever 
possible  to  help  build  new  plans  out  of  old  plans.  Successful  plans  are  indexed 
by  the  goals  they  satisfy  and  the  problems  they  avoid.  Plan  failures  are  indexed 
by  the  features  in  the  world  that  help  predict  them.  Knowing  the  paths  that  lead 
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to  failure,  enables  planners  to  recognize  the  conditions  that  lead  to  the  failure 
and  consequently  avoid  going  down  that  path  again. 

Hammond's  (1990)  research  is  focused  on  plan  failure  and  plan  repair. 
Hammond  characterizes  failures  in  terms  of  plan-goal  interactions  and  indexes 
plan  repairs  by  causal  descriptions  of  the  problems  they  solve.  She  has 
developed  a  specific  vocabulary  that  provides  a  distinct  causal  description  of 
plan-goal  interactions  to  explain  why  a  plan  failed.  This  causal  description  will 
then  be  linked  to  a  plan  repair  designed  to  deal  with  that  particular  plan/  goal 
interaction  failure. 

2.4  Event-Driven  Replanning  vs.  Plan  Generation,  Plan  Repair,  and  Adaptive 
Planning 

There  are  several  factors  which  differentiate  event-driven  replaiming 
from  plan  generation,  plan  repair,  and  adaptive  planning.  Event-driven 
replanning  is  not  plan  generation  (Sarcedoti,  1974;  Hayes-Roth  and  Hayes-Roth, 
1979;  Wilensky,  1981).  Event-driven  replanning  deals  with  activities  that  are 
occurring  right  now,  where  as  plan  generation  deals  with  activities  projected  to 
occur  in  the  future.  Event-driven  replarming  is  more  than  simply  plan  repair. 
Hammond  (1990)  claims  that  the  most  powerful  approach  to  plan  repair  is  to 
have  the  planner  explain  and  then  debug  any  failures  that  are  detected.  In 
event-driven  replanning  as  observed  in  aeromedical  evacuation,  failure  to 
execute  a  plan  properly  is  a  serious,  potentially  life  threatening  issue  whereas  a 
failure  executed  by  Hammond's  case-based  plarmer  CHEF,  might  result  in  a 
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soggy  batch  of  Szechwan  beef  and  broccoli.  The  key  point  here  is  that  failures 
cannot  and  do  not  drive  the  event-driven  replanning  process  but  rather 
constraints  which  impede  the  ability  to  successfully  attain  the  goals  at  hand  do. 
As  such,  just  as  a  cased-based  planner  indexes  successes  and  failxrres  to  guide 
future  planning  endeavors,  aeromedical  evacuation  planners  index  techniques 
that  allow  them  to  successfully  recognize  and  manage  constraints  to  conduct 
future  plan  developments. 

Models  of  reactive  or  adaptive  planning  are  far  from  possessing  the 
sophistication  required  to  perform  event-driven  replanning  in  a  complex 
environment.  Current  models  claim  to  be  reactive  when  robots  can  move  freely 
through  an  unknown  space  without  bumping  into  walls.  Current  models  also 
claim  to  be  dynamic  when  a  robot  can  move  blocks  around  the  room  with  a 
mischievous  baby  on  the  loose  (Schoppers,  1987;  Ambros-Ingerson  &  Steel, 

1988).  Adthough  advances  have  clearly  been  made  with  respect  to  creating  more 
realistic  representations  of  more  dynamic  and  more  complicated  worlds,  cxurent 
artificial  intelligence  models  stiU  fall  short  of  representing  the  complexity  that 
actually  exists  in  real  world,  dynamic  environments. 
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CHAPTERS 


THE  DOMAIN  OF  STUDY:  MILITARY  AEROMEDICAL  EVACUATION 


3.1  Introduction 

The  Department  of  Defense  Aeromedical  Evacuation  (AE)  System 
establishes  policy,  develops  plans,  and  executes  procedures  for  the  transport  of 
injured  or  ill  mihtary  members  and  dependents  of  military  members  during 
peacetime,  wartime,  and  contingency  operations.  Aeromedical  evacuation 
combines  the  skills  of  mission  planners,  medical  personnel,  administrators,  and 
aircrews  who  are  dispersed  in  locations  throughout  the  world. 

3.2  The  Aeromedical  Evacuation  Planning  Processes 

Aeromedical  evacuation  involves  two  processes:  plan  generation  and 
event-driven  replanning. 

1.  Plan  generation  constitutes  the  bulk  of  the  activity  of  the  aeromedical 
evacuation  system.  It  is  the  daily  planning  of  resources  and  demands  that  are 
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forecasted  for  the  near  term  (2-5  day  period).  Plan  generation  consists  of  the 
following  primary  tasks: 

(a)  identifying  and  designating  the  most  appropriate  medical  treatment 
facility  available  for  a  given  patient; 

(b)  arranging  the  necessary  equipment,  medical  attendants,  and 
transportation  required  to  provide  effective  in-transit  patient  care; 

(c)  planning  the  most  efficient  route  to  deliver  patients  to  designated 
facihties. 

2.  Event-driven  Replanning,  which  is  the  focus  of  this  research,  is  a 
dynamic  process  that  reacts  to  new  information  in  the  present.  Event-driven 
replanning  requires  practitioners  to  perform  all  of  the  plan  generation  tasks  plus 
manage  the  cascading  disruptions  that  result  as  plans  are  rebuilt  in  real  time. 
During  event-driven  replanning,  practitioners  must  track  and  manage  multiple 
threads  of  activity  vmder  time  pressure.  Threads  of  activity  include: 
reexamining  resource  allocations,  disrupting  plans  in  progress,  changing 
itineraries,  and  dealing  with  the  consequences  of  those  disruptions  and  changes. 
Weather,  mechanical  malfunctions,  medical  emergencies,  airfield  closures,  and 
in-flight  emergencies,  etc.  are  potential  disruptions  which  act  as  catalysts  for 
event-driven  replanning.  This  cases  presented  in  this  research  dealt  primarily 
with  medical  emergencies. 

To  a  large  extent,  the  planners  responsible  for  arranging  patient  transport 
depend  on  other  agents  in  the  aeromedical  evacuation  system  to  provide 
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relevant  and  accurate  information  in  order  to  generate  feasible  plans.  Plan 
generation  and  event-driven  replanning  requires  visualization  of  aircraft 
configurations,  flight  routes,  hospital  locations,  etc.  Planners  must  be  able  to 
track,  organize,  and  manipulate  information.  They  need  to  know  or  establish 
criteria  for  plan  comparison. 

3.3  The  Complexity  of  Aeromedical  Evacuation 

The  aeromedical  evacuation  system  operates  within  a  highly  complex, 
distributed  enviromnent  that  by  its  very  nature  is  time  restricted,  conflict  rich, 
riddled  with  imcertainty,  and  high  in  risk.  A  distributed  environment  denotes 
an  environment  where  information,  authority,  and  accountability  may  reside 
with  multiple  people  separated  by  either  space  or  time.  There  are  four 
characteristics  that  typify  complexity  and  define  the  cognitive  demands  of  an 
environment:  dynamism,  intercormectedness,  uncertainty,  and  risk  (W oods 
1988). 

1.  Dynamism  -  A  dynamic  environment  is  one  where  information  and 
events  change  over  time.  As  such,  information  and  events  drive  the  planning, 
problem-solving  and  decision  making  processes  in  these  environments.  Event 
driven  processes  are  characterized  by  time  pressure,  overlapping  tasks,  and 
sustained  performance.  The  very  nature  of  problems  or  the  process  itself  may 
change  at  any  point  as  new  information  is  injected  into  the  system.  Patient 
movement  requests  (PMRs)  are  the  primary  drivers  in  the  medical  evacuation 
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system.  PMRs  can  be  entered  into  the  system  at  any  point  and  totally  alter  the 
evacuation  plan  in  progress.  For  instance;  imagine  that  an  aircraft  carrying  20 
routine  patients  was  scheduled  to  travel  from  point  A  to  point  B  at  1500  hours. 

At  1445  hours  an  Urgent  PMR  (urgent  denotes  the  highest  priority  for  patient 
movement  indicating  a  potential  loss  of  life  or  limb  situation)  comes  in  with  a 
patient  that  needs  to  go  from  point  A  to  point  Z.  If  the  aircraft  scheduled  to 
depart  at  1500  is  the  only  aircraft  available,  then  the  20  patients  originally 
scheduled  to  go  to  point  B  will  be  delayed  or  reschedtded.  Other  events  that  can 
drive  the  evacuation  process  are;  weather,  airfields,  and  aircraft  availability. 
Weather  may  cause  airfields  to  close,  delay  flights,  etc.  Airfields  can  have  radar 
problems,  runway  problems,  etc.  which  makes  them  unsuitable  for  landing. 
Aircraft  may  break  down  or  be  configured  in  ways  that  preclude  transporting 
certain  categories  of  patients. 

2.  Interconnectedness  -  refers  to  the  coupling  of  the  components  or  agents 
that  comprise  the  process.  The  degree  of  interconnectedness  affects  the  range  of 
disruptions  that  may  occur  and  the  consequences  of  those  disruptions  on  the 
system.  Competing  goals  can  also  result  from  intercoimectedness  as  different 
geographical  areas  of  responsibility  (theaters)  pursue  locally  relevant  goals  that 
conflict  with  the  broader  perspective  of  global  goals.  As  indicated  in  the 
previous  example,  one  disruption  (an  Urgent  PMR)  affected  20  other  patients.  In 
addition,  conflicts  exist  within  and  between  theaters  as  they  try  to  achieve  local 
goals  with  globally  constrained  resources. 
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3.  Uncertainty  -  refers  to  the  inability  to  completely  anticipate  future 


states  and  events.  This  can  occur  because  of  vague,  faulty,  or  incomplete 
information,  volatile  circumstances,  and  fragile  situations.  The  aeromedical 
evacuation  environment  is  filled  with  uncertainty.  Weather  changes,  planes 
break  down,  patients'  conditions  deteriorate  unexpectedly,  illnesses  are 
misdiagnosed,  disasters  occur,  etc. 

4.  Risk  -  refers  to  danger  and  the  knowledge  that  situations  could  have 
dire  consequences.  The  presence  of  risk  implies  choices  and  tradeoffs  will  have 
to  be  made.  Medical  evacuation  deals  with  life  and  death  situations. 

As  can  be  seen,  aeromedical  evacuation  depends  on  detailed  plans  to 
coordinate  the  transport  and  care  of  patients  around  the  world.  The  complex 
and  distributed  nature  of  aeromedical  evacuation  makes  it  a  superb  environment 
in  which  to  study  the  cognitive  characteristics  of  event-driven  replanning. 
Aeromedical  evacuation  plaimers  must  adjust  to  changing  events,  manage  the 
cascade  of  disruptions  that  ripple  through  the  system  in  response  to  those 
events,  solve  problems,  make  decisions,  and  ultimately  rebuild  plans  in  real 
time. 

Another  important  characteristic  that  underscores  the  complexity  of  the 
aeromedical  evacuation  environment  is  that  it  is  physically  and  functionally 
distributed.  Distributed  environments  result  when  information  used  in 
planning  decisions,  responsibility  and  accountability  for  making  choices,  and  the 
ability  to  change  course  or  override  plans  is  scattered  among  different 
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individuals  or  units,  and/or  separated  by  space  or  time  (  Fischhoff  and  Johnson, 
1990). 

3.4  The  Global  Patient  Movement  Requirements  Center 

The  Global  Patient  Movement  Requirements  Center  (GPMRC)  resides  in  a 
building  on  the  flight  line  at  Scott  AFB  in  Belleville,  fllinois.  The  GPMRC  is  co¬ 
located  with  the  375th  Air  Lift  Unit  Command  Post  to  facilitate  the  coordination 
between  airborne  assets  and  patient  movement.  The  walls  of  the  small  control 
room  are  covered  with  maps,  status  boards,  equipment  lists,  and  digital  clocks. 

A  big  screen  television  is  projected  on  the  front  wall  and  a  door  that  permits 
easy  access  to  Command  Post  is  the  focal  point  of  the  rear  wall. 

3.4.1  The  Participants 

Multiple  personnel,  dispersed  in  locations  throughout  the  coimtry,  both 
on  the  ground  and  in  the  air,  participate  in  the  event-driven  replanning  process. 
The  crew  at  the  GPMRC  consists  of  a  Flight  CHnical  Coordinator  (FCC),  a  Duty 
Officer  (DO),  and  a  Controller  (CTL).  They  are  responsible  for  planning  and 
coordinating  the  activities  required  to  transport  the  urgent  patient.  Other  key 
players  included  the  Aeromedical  Evacuation  Clerk  (AEC),  the  Attending 
Physician  (AP),  the  Receiving  Physician  (RP),  the  Medical  Crew  Director  (MCD), 
and  the  crew  of  the  Command  Post  (CP).  The  roles  of  each  of  the  participants 
will  be  explained  below: 
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Flight  Clmical  Coordinator  (FCC)  -  is  a  flight  ntirse  who  is  the  chief 
validator  of  medical  information.  He/she  monitors  and  trouble  shoots  all 
present  missions  with  respect  to  patient  care,  advises  the  MCD,  orchestrates 
Urgent  and  Priority  requests,  and  ensures  that  all  provisions  have  been  made  to 
meet  the  needs  of  each  patient 

Duty  Officer  (DO)  -  is  the  mission  planner.  He/  she  checks  system 
assignment  of  patients,  and  manually  assigns  patients  and  plans  missions. 

Controller  (CTL)  -  monitors  missions,  updates  status  boards,  and  keeps 
Aeromedical  Evacuation  Clerks  updated  on  mission  status. 

Command  Post  (CP)  -  group  of  individuals  responsible  for 
communicating  with  the  flight  crew  and  ensuring  all  aspects  of  the  mission 
related  to  the  aircraft  and  aircrew  are  taken  care  of.  They  handle  flight  plans, 
diversions,  refueling,  etc. 

Medical  Crew  Director  (MCD)  -  chief  flight  nurse  onboard  the  aircraft  and 
in  charge  of  the  airborne  medical  crew.  The  medical  consists  of  2  flight  nurses 
(including  the  MCD)  and  3  medical  technicians. 

Aeromedical  Evacuation  Clerk  (AEC)  -  clerk  at  originating  Medical 
Treatment  Facilities  responsible  for  submitting  PMR's  to  GPMRC. 

Attending  Physician  (AP)  -  doctor  currently  administering  care  to  the 
patient  at  the  originating  MTF. 

Receiving  Physician  (RP)  -  doctor  who  will  receive  the  patient  and  be 
responsible  for  his  or  her  treatment  at  the  destination  MTF. 
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3.4.2  Cognitive  Artifacts 

3.4.2.1  Computer  Tools.  Currently,  aeromedical  evacuation  is  supported  by  a 
computer  based  patient  record  keeping  system  known  as  the  Defense  Medical 
Regulating  Information  System  (DMRIS)  and  a  semi-automated  scheduling 
system  known  as  the  Aeromedical  Patient  Evacuation  System  (APES).  The 
DMRIS  is  designed  to  manage  patient  regulating  and  patient  movement 
information.  PMRs  are  initiated  by  AECs  at  local  MTFs  via  the  DMRIS.  The 
DMRIS  contains  97  fields  of  administrative  and  clinical  data  that  are  evaluated 
by  qualified  GPMRC  personnel.  It  possesses  a  marginal  degree  of  intelligence  in 
that  it  restricts  data  entry  in  some  fields  and  blocks  progressing  through  fields 
when  required  entries  have  not  been  made.  In  addition,  when  the  system 
detects  an  error,  it  highlights  the  field  causing  the  problem.  Unfortunately  the 
system  possesses  minimal  intelligence  with  regards  to  imderstanding  the  data 
input  or  checking  for  consistency  between  data  fields.  This  task  is  performed  by 
FCC's  at  the  GPMRC.  FCC's  check  over  every  PMR  that  comes  into  the  GPMRC. 
At  times,  however,  the  DMRIS's  limited  intelligence  creates  unnecessary  work 
and  confusion.  This  occurs  when  an  AEC  wants  to  specify  a  particular  medical 
treatment  facility  (which  is  common)  outside  of  the  DMRIS's  programmed 
selection  of  venue.  The  DMRIS  is  programmed  to  send  a  patient  to  the  closest 
facility  that  has  the  capability  to  suit  the  patienT s  need.  Although  this  is  a  nice 
feature  to  have  built  into  the  system  at  most  times,  it  is  a  major  encumbrance 
whenever  there  is  a  patient  requirement  to  deviate  from  this  logic.  As  a  result. 
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practitioners  are  forced  to  devise  methods  to  trick  the  system,  so  that  they  will  be 
"allowed"  to  enter  the  data  that  suits  the  patient's  requirements  instead  of  the 
DMRIS's  logic. 

Once  the  data  has  been  accepted  by  the  DMRIS,  it  must  be  evaluated  for 
administrative  and  clinical  validity.  For  example:  Does  the  diagnosis 
correspond  with  the  patient s  vital  signs  and  medical  history?  Once  an  FCC 
determines  that  the  input  is  valid,  the  record  is  automatically  passed  to  the 
Aeromedical  Patient  Evacuation  System  (APES).  The  APES  then  assigns  the 
patient  to  one  of  the  scheduled  missions  (this  is  the  only  "automation"  that 
exists  in  the  current  system).  Unfortunately,  this  system  also  possesses  limited 
intelligence  and  is  consequently  unable  to  handle  anything  but  the  simplest 
movement  requests.  For  instance;  if  the  patienP s  origination  and  destination  are 
not  one-to-one  matches  with  a  scheduled  mission,  the  APES  will  not  assign  the 
patient  The  APES  is  not  programmed  to  handle  cases  where  patients  would 
have  to  fly  to  one  place,  stay  over  night  and  then  catch  another  flight  the  next 
day.  As  a  result,  the  APES  rejects  these  requests  and  they  have  to  be  done 
manually.  Unfortunately,  rejections  are  fairly  common. 

3.4.2.2  Big  Screen  Television.  A  big  screen  television,  which  is  usually  tuned  to 
the  weather  channel,  is  projected  on  the  front  wall.  Weather  channel  access 
allows  the  GPMRC  staff  to  anticipate  problems  or  delays  by  observing  current 
weather  activity  and  weather  patterns  that  may  be  developing  around  the 
country. 
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3.4.2.3  Mission  Status  Board.  A  large  mission  status  board  occupies  the  right 
wall  of  the  control  room.  It  lists  the  aircraft,  mission  segments,  airfields,  times, 
and  patient  loads  for  each  mission  scheduled  to  fly  that  day.  Typically  there  are 
between  4  and  6  missions  flying  in  the  continental  United  States  every  weekday. 
Different  colored  grease  pencils  are  used  to  annotate  changes  and  differing 
movement  priorities  on  the  status  board.  Patient  movement  requests  (PMR's) 
are  classified  as;  Routine  -  must  be  moved  within  72  hoxirs.  Priority  -  must  be 
moved  within  24  hours,  or  Urgent  -  must  be  moved  within  8  hours.  Yellow  is 
used  to  indicate  changes  to  the  original  plan.  For  instance;  if  a  plane  takes  off 
late,  the  revised  time  is  written  in  yellow.  Red  and  orange  are  used  to  indicate 
Urgent  and  Priority  patients  respectively.  All  other  information  is  annotated  in 
black.  Bracketed  lines  are  used  to  highlight  important  connections  between 
mission  segments.  For  instance;  brackets  are  used  to  highlight  pick-up  and  drop 
of  points  for  Urgent  and  Priority  patients.  In  addition,  brackets  are  used  to 
emphasize  altitude  restrictions.  The  affected  mission  segments  are  bracketed 
and  the  corresponding  altitude  Hmit  is  aimotated  above  the  line.  Twelve  digital 
clocks,  marking  the  time  at  various  world  wide  locations,  are  situated  above  the 
mission  status  board.  The  GPMRC  schedules  operates  on  Zulu  time. 

The  mission  status  board  provides  mission  planners  with  a  store  of  useful 
information  at  a  glance.  It  is  the  first  place  mission  planners  will  look  to  seek 
alternative  courses  of  action  when  unanticipated  events  arise. 
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3.4.2.4  Planning  Map.  A  large  map  of  the  United  States  occupies  the  wall  next 
to  the  do's  desk.  The  map  has  hundreds  of  pins  anchored  at  the  airfields  where 
the  planes  can  land.  The  DO  plans  routes  by  running  a  string  from  pin  to  pin 
and  then  measxuing  the  distance  by  stretching  the  string  out  on  a  scale  at  the 
bottom  of  the  map  to  determine  distance  in  miles.  He  then  refers  to  a  conversion 
chart  posted  to  the  side  of  the  map  that  allows  him  to  convert  miles  into 
estimated  flight  times.  The  length  of  the  string  is  the  equivalent  of  a  crew  duty 
day.  Consequently,  if  the  DO  runs  out  of  string  while  trying  to  plan  ("string")  a 
mission,  s/he  knows  that  the  intended  plan  will  fail  because  it  violates  crew 
duty  day  limits.  In  fact,  several  DOs  remarked  that  the  map/ string/  chart 
system  generally  produces  more  accurate  estimates  of  distance  and  time  than  the 
APES  computer  system. 

3.4.2.5  Equipment  Requirements  Board.  An  equipment  requirements  board  is 
situated  next  to  the  FCC's  desk.  It  serves  as  a  reminder  of  special  equipment 
needs  for  the  following  days'  flights. 
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CHAPTER  4 


METHODOLOGY 


4.1  Introduction 

The  data  collected  for  the  purpose  of  this  research  was  accxunulated  over 
an  eighteen  month  period.  Data  collection  opportunities  included  numerous 
interviews  and  direct  observations  at  various  levels  of  the  aeromedical 
evacuation  domain.  Several  weeks  were  spent  observing  routine  and  emergency 
operations  at  the  GPMRC.  Observations  were  also  made  during  a  full  scale 
Naval  medical  evacuation  exercise  at  Camp  Pendelton,  CA.  This  provided  an 
excellent  opportunity  to  observe  simulated  wartime  patient  evacuation. 

In  addition,  observations  and  interviews  were  also  conducted  onboard 
the  C-9  Nightingale  during  actual  aeromedical  evacuation  missions.  This 
afforded  the  opportunity  to  experience  aeromedical  evacuation  at  "the  sharp 
end"  to  gain  a  better  imderstanding  of  the  requirements  and  demands  imposed 
on  the  medical  crew  and  the  patients.  Observations  and  interviews  were 
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conducted  with  AECs  at  a  regional  MTF  and  a  reserve  squadron  preparing  for 
overseas  patient  evacuation.  This  broad  exposure  to  the  various  facets  of  the 
aeromedical  evacuation  environment  provided  a  deeper  understanding  of  the 
domain  which  afforded  an  opportunity  to  see  "the  big  picture". 

The  observations  and  interviews  conducted  during  the  exploratory  and 
data  collection  phases  of  this  research  provided  the  basis  for  the  analysis  of  the 
cognitive  demands  and  strategies  of  event-driven  replanning  in  the  aeromedical 
evacuation  environment  Observations  afforded  opportunities  to  capture  the 
verbal  behavior  of  practitioners  engaged  in  actual  event-driven  replaiming 
activities.  Interviews  were  conducted  to  explain  and  confirm  those  activities 
observed  during  the  event-driven  replanning  episodes. 

The  cases  recorded  in  this  study  were  directly  observed  by  the  author 
who  was  present  during  each  episode  to  witness  the  event-driven  replanmng 
process  in  real  time.  As  such,  the  author  was  able  to  not  only  record  the  verbal 
communications  but  also  note  the  behavior  and  actions  of  participants  as  events 
unfolded. 

4.2  Verbal  Protocol 

Verbal  behaviors  are  situated  expressions  of  a  task  related  activity  such 
as;  commxmications  between  multiple  people,  requests  for  information,  etc. 

They  are  the  actual  verbalizations  that  occurs  in  the  performance  of  a  task. 
Verbal  reports,  on  the  other  hand,  are  verbal  descriptions  of  a  task  provided  by 
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the  person  performing  the  task.  Verbal  reports  can  be  given  concurrently  -  as  the 
task  is  being  performed,  or  retrospectively  -  after  the  task  has  been  performed. 
Concurrent  verbal  reports  are  sometimes  called  think  aloud^^  protocols. 

The  conversations  which  formed  the  basis  of  the  analysis  used  in  this 
research  consisted  of  the  natural  discourse  that  occurred  between  the 
participants  of  the  GPMRC  while  engaged  in  the  event-driven  replanning 
process. 

Fortunately,  some  of  the  conversations  between  members  of  the  GPMRC 
and  remote  participants  were  conducted  over  a  speaker  phone  so  that  the 
communication  between  both  parties  could  be  recorded.  In  all  other  cases,  the 
conversations  exchanged  between  parties  over  the  telephone  were  communi¬ 
cated  after  the  fact  as  the  person  on  the  telephone  relayed  information  to  the 
other  members  of  the  GPMRC.  In  addition,  members  of  the  GPMRC  provided 
imsolicited  verbal  reports  to  explain  events  and  activities  as  time  permitted.  On 
one  occasion,  a  member  of  the  GPMRC  provided  an  xmsolicited  verbalization  of 
a  mental  simulation.  At  other  times,  verbal  reports  were  solicited  by  the  author 
during  gaps  in  activity  and  at  the  end  of  the  episodes  to  clarify  tmcertainties  in 
the  data. 

Since  much  of  the  activity  and  coordination  required  to  devise  a  plan  to 
transport  the  urgent  patient  occurred  in  parallel,  it  was  impossible  to  capture 
every  conversation  that  occurred  among  the  five  members  of  the  GPMRC. 
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Consequently,  the  observations  and  recordings  collected  during  this  study 
focused  on  the  principle  participants;  the  FCC  and  the  DO. 

4.3  Analysis 

The  observations  and  recordings  from  this  case  were  examined  using  a 
technique  known  as  protocol  analysis.  Protocol  analysis  is  used  to  identify  and 
understand  the  cognitive  aspects  of  a  complex  episode  (W oods,  1993).  The 
objective  of  protocol  analysis  is  to  lay  out  a  problem  solving  episode  from  the 
point  of  view  of  the  participants.  The  goal  is  to  understand  how  a  process 
evolves  and  is  assessed  through  the  eyes  of  the  those  involved.  This  requires 
understanding  the  perceptual  and  cognitive  cues  that  activate  knowledge,  and 
how  knowledge  and  goals  giride  the  actions  of  the  participants. 

Complications  inherent  in  the  aeromedical  evacuation  environment  create 
complexity  across  people  and  time.  Understanding  the  behavioral  aspects  of  a 
task  is  particularly  difficult  when  the  process  involves  multiple  agents 
distributed  in  various  locations  throughout  the  country  and  in  the  air.  This 
difficulty  is  magnified  when  multiple  issues  and  activities  began  to  overlap  and 
intertwine  as  the  situation  evolved. 

To  cope  with  the  difficulties  of  coordinating  activities  across  people  and 
time,  a  goal  decomposition  was  used  to  structure  the  data  for  the  protocol 
analysis  used  in  this  study.  The  goals  were  identified  and  decomposed  as 
follows: 
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Goal  -  Verify  Patient' s  Status 
Goal  -  Arrange  Transportation 

Sub-goal  -  search  for  opportune  aircraft 
Sub-goal  -  search  for  plane  to  divert 
Sub-goal  -  determine  where  to  land 
Sub-goal  -  arrange  ground  transportation 
Sub-goal  -  modify  mission/  drop  last  stop 
Sub-goal  -  modify  mission/ manage  secondary  disruptions 
Goal  -  Manage  Patient 

Sub-goal  -  update  patient  status 
Sub-goal  -  find  destination  MTF/RP 
Sub-goal  -  search  for  medical  attendant 
Sub-goal  -  equipment  requirement 
Goal  -  Commit  to  the  Plan 

Sub-goal  -  administration 
Sub-goal  -  enter  plan  into  computer 
The  goal  decomposition  framework  facilitated  laying  out  the  different 
activities  and  events  to  expose  the  cognitive  elements  in  the  protocols 
(Rasmussen,  1985).  This  entailed  identifying  the  steps  required  to  accompHsh 
the  goals,  what  data  was  acquired,  how  the  situation  was  assessed,  what 
knowledge  was  activated,  and  what  triggered  those  acquisitions,  assessments, 
and  activations.  The  protocols  revealed  the  cormections  between  behaviors  and 
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activities  that  led  to  either  a  decision,  an  action,  or  a  request  for  additional 
knowledge.  These  connections  are  illustrated  by  tracing  the  perception-action 
cycle  to  expose  how  events  in  the  world  are  picked  up,  how  they  trigger  or  shift 
different  lines  of  reasoning,  and  how  those  lines  of  reasoning  lead  to  intentions 
and  action  (Neisser,  1976).  This  provided  a  way  to  capture  the  mindset  of  the 
participants  as  they  responded  to  new  information,  shifted  lines  of  reasoning, 
and  made  decisions. 

The  observations  and  recordings  of  the  verbal  and  non-verbal  behaviors, 
verbal  reports,  and  activities  of  the  participants  during  this  episode  provided  the 
basis  for  the  protocol  analysis. 

An  example  of  how  the  perception-action-cycle  was  used  in  this  analysis, 
is  shown  in  Figure  2. 

Using  the  perception-action-cycle  helped  generate  the  layout  that  was 
used  in  the  protocols.  Reading  horizontally  across  the  bottom  of  the  data  driven 
and  knowledge  driven  arcs  of  the  cycle  chronicled  the  activities  that  were  taking 
place  during  the  execution  of  a  particular  task.  Reading  horizontally  across  the 
top  of  the  cycle,  revealed  the  mindset  of  the  participants.  The  dashed  hnes  are 
used  to  indicate  information  coming  into  the  GPMRC. 

Although  the  example  provided  in  Figure  2  is  rather  straight  forward,  a 
typical  perception-action-cycle  can  become  extremely  convoluted  as  new 
information  can  enter  m  at  any  point  in  the  cycle  triggering  multiple  lines  of 
reasoning  or  spawning  new  perception-action-cycles.  Information  infused  at  one 
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Figure  2.  Perception  -  Action  -  Cycle  for  the  Verify  Urgent  Status  goal.  The 
phone  call  from  the  AEC  at  Keesler  AFB  is  the  data  driven  event  in  the  world 
that  triggers  this  cognitive  process.  The  caU  immediately  activates  the  FCC  & 
do's  knowledge  of  the  criteria  used  to  determine  urgent  status  and  their 
authority  to  make  such  a  determination.  They  quickly  recognize  the  need  for 
additional  information  to  begin  processing  this  event  The  DO  begins 
questioning  the  AEC  to  learn  more  about  the  patient s  condition  while  the  FCC 
reviews  policy  on  their  authority  to  verify  urgent  status.  The  new  information 
acts  as  a  new  trigger  to  activate  the  FCC  &  DO's  medical  knowledge  so  that  they 
can  process  this  information,  assess  the  situation,  and  make  a  decision.  They 
decide  the  situation  is  indeed  urgent  and  they  do  have  the  authority  to 
orchestrate  the  movement  of  the  patient.  This  also  serves  as  a  trigger  to  begin 
arranging  transport. 
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point  can  created  its  own  mini-cycle  until  the  final  cycle  is  a  composition  of 
multiple  mini-cycles.  At  times  it  can  be  difficult  to  ascertain  where  a  cycle 
begins  or  ends.  However,  the  crucial  point  is  to  identify  the  cognitive  cues  that 
activate  knowledge  and  trigger  a  particular  mindset  Understanding  cue 
utilization  and  knowledge  activation  can  then  be  used  to  comprehend  the 
decisions  or  actions  that  follow. 

4.4  Structure  of  the  Protocol 

The  basic  task  flow  of  the  protocol  was  derived  from  the  goal 
decomposition.  The  protocol  outlines  the  information  flow  and  identifies  the 
actors,  actions,  and  outcomes  associated  with  each  task.  It  is  from  the  FCCs  and 
DO's  points  of  view  although  activities  continued  "behind  the  scenes"  for  aU 
other  participants.  The  protocol  strives  to  capture  the  mindset  of  the  participants 
and  the  multiple  threads  of  activity  that  emerge  and  intertwined  as  the  situation 
unfolded.  It  displays  how  threads  of  activities  were  dropped  and  then 
reemerged  at  a  later  time  or  how  tasks  closed  and  were  then  reopened  as  loose 
threads  became  visible. 

There  are  five  columns  of  information  on  each  page  of  the  protocol.  They 
are;  1)  Time,  2)  Event/Task,  3)  Mindset,  4)  Activity  Inside  GPMRC,  and  5) 
Commentary.  Reading  row  by  row  across  the  protocol  allows  the  reader  to 
follow  and  understand  the  behavioral  and  cognitive  aspects  of  each  event  as  the 
case  progresses  by  identifying  the  when,  what,  who,  where,  and  why  aspects  of 
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each  activity.  The  protocol  can  also  be  read  column  by  column.  For  instance; 
reading  down  the  column  labeled  "Mindset"  reveals  the  key  participants' 
evolving  interpretation  of  events  as  the  episode  unfolded.  A  brief  description  of 
the  content  of  these  columns  follows: 

1)  Time  -  Identifies  relative  time  steps  that  mark  sequences  of  activity. 

The  space  allocated  for  each  event  does  not  represent  actual  time  intervals  but 
rather  a  subjective  indication  of  the  complexity  of  explaining  a  particular 
activity. 

2)  Event/Task  -  Describes  the  tasks  and  subtasks  that  are  the  focus  of  the 
activity  during  a  given  time  period.  The  events  and  tasks  are  based  on  the  goal 
decomposition  (primary  tasks  equate  to  goals  and  subtasks  are  the  same  as 
subgoals).  Reading  down  this  column  allows  the  reader  to  understand  the  basic 
flow  of  tasks  throughout  the  episode. 

To  facilitate  tmderstanding  the  task  flow,  rectangles  are  used  to  indicate 
primary  tasks  and  ovals  are  used  to  indicate  subtasks.  Tasks  or  subtasks  can  be 
shared  by  multiple  agents  or  they  can  be  split  with  each  agent  working  on  a 
different  task  or  subtask  at  a  time.  When  parallel  activities  occur,  they  are 
shown  in  sequence  rather  than  in  parallel  (see  Figure  3).  Both  subtasks  are 
shown  but  only  one  comes  to  the  foreground  and  is  explained  at  a  time.  The 
background  subtask  will  have  a  shaded  background  and  dashed  tine 
coimections.  The  foreground  subtask  will  have  a  clear  backgroimd  and  straight 
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line  connections.  The  foreground  subtask  and  all  of  its  components  will  be 
shown  to  completion.  Once  the  foreground  subtask  is  completed,  time  reverts 


Figure  3.  Task  Flow.  Drawing  (a)  depicts  a  Task  X  which  is  spHt  into  2  separate 
subtasks.  The  subtasks  and  their  associated  steps  occur  in  parallel.  When  the 
subtasks  are  completed,  the  parties  rejoin  and  begin  a  new  Task  Y. 
Unfortunately,  this  parallel  depiction  of  subtasks  makes  it  very  difficidt  to 
follow  the  mindset,  activities,  and  comments  associated  with  the  respective 
subtask.  To  provide  clarity,  the  protocol  depicts  the  subtasks  serially  as  in 
Drawing  (b).  In  this  drawing  at  tx  both  subtasks  1.1  and  1.2  are  shown  but  only 
subtask  1.1  is  in  the  foreground  and  is  shown  in  its  entirety  to  time  tx+i.  The 
drawing  then  goes  back  to  time  tx  and  the  subtask  2.1,  which  was  previously  in 
the  background,  comes  to  the  foreground  and  is  explained  in  its  entirety  to  time 
tx+i.  The  two  subtasks  then  converge  and  activity  commences  on  a  new  Task  Y  at 
time  tx+2. 
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back  to  the  juncture  where  the  original  subtasks  split.  At  that  point,  the 
foreground  subtask  moves  to  the  background  and  the  background  subtask 
comes  to  the  foregroimd  and  is  shown  to  completion.  In  other  words,  only  one 
task  is  described  at  a  time  form  a  particular  time  sequence.  For  example,  the 
first  task  will  be  shown  from  time  tx  to  ty.  Then,  time  goes  back  to  tx  to  show 
what  happened  to  the  second  task  during  that  same  tx  to  ty  time  frame. 

3)  Mindset  -  Specifies  the  inferred  description  of  the  participants'  thought 
processes  and  intentions  based  on  the  information  and  event  triggers. 

4)  Activity  Inside  GPMRC  -  Describes  the  actions  that  participants  inside 
GPMRC  took  in  response  to  the  task  under  consideration  and  the  information 
available  at  that  time. 

5)  Commentary  -  Provides  additional  insight  into  the  activities  that  took 
place  during  the  respective  time  frame.  There  are  4  types  of  commentaries:  1) 
Unsolicited  explanations  are  voluntary  explanations  of  events  or  activities 
provided  by  participants  of  GPMRC  to  the  author  as  an  observer;  2)  Solicited 
explanations  are  explanations  that  are  the  result  of  specific  probes  by  the 
observer;  3)  UnsoHcited  "think  aloud"  reports  are  volrmtary  verbalizations  of 
mental  simulations;  and  4)  Observer  narratives  are  explanations  provided  by  the 
author  to  put  events  in  context  for  the  reader. 

Closure  means  the  plan  was  established,  coordinated,  communicated,  and 
accepted  by  all  relevant  participants. 
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CHAPTERS 


RESULTS 


5.1  Introduction 

The  three  cases  presented  in  this  chapter  are  actual  event-driven 
replanning  episodes  that  were  directly  observed  at  the  GPMRC.  Each  case 
presents  unique  situations  and  problems  which  evoke  distinct  replanning 
strategies  and  techniques  from  practitioners  thus  providing  different 
perspectives  of  the  event-driven  replanning  process  within  the  domain.  The  first 
case  is  an  Urgent  PMR  which  involves  a  kidney  transplant  patient  at  a  civilian 
hospital  with  a  potentially  critical  secondary  medical  condition  that  produces 
additional  complications.  The  second  case  is  also  an  Urgent  PMR  but  it  involves 
a  hospital  located  outside  of  the  CONUS  which  poses  mrdque  problems.  Another 
interesting  twist  to  this  case  is  the  emergence  of  an  imusually  compelling 
secondary  disruption  that  warrants  special  consideration  by  the  crew  at  the 
GPMRC.  The  third  and  final  case  involves  correcting  an  equipment 
compatibilily  error  previously  committed  for  transporting  a  priority  patient 
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Although  each  case  possesses  unique  characteristics,  they  also  have 
interesting  collective  aspects  ihat  make  ihem  suitable  candidates  for  case  study 
evaluation. 

First,  these  were  all  non-routine  cases.  Non-routine  cases  provide 
stressors  that  expose  the  strengths  and  weaknesses  inherent  in  a  system  or 
process  that  are  not  visible  during  routine  operations.  Normal  daily  operations 
at  the  GPMRC  consist  of  arranging  and  scheduling  routine  PMR' s.  Since 
planners  are  given  72  hours  to  arrange  a  routine  patient,  and  24  hours  to  arrange 
a  priority  patient,  they  fall  under  the  realm  of  plan  generation.  Urgent  patients, 
on  the  other  hand,  fall  within  the  realm  of  event-driven  replanning  because 
patient  movement  must  be  arranged  within  a  maximum  of  8  hours.  Because  of 
the  limited  amoxmt  of  time  available  to  respond  to  an  Urgent  PMR,  planners 
must  replan  and  reallocate  resources  in  real  time. 

Second,  a  number  of  complicating  factors  arose  in  each  of  these  incidents 
which  turned  these  cases  into  interesting  expressions  of  cognitive  adaptability 
and  naturalistic  decision  making.  Complicating  factors  included:  conflicting 
diagnoses,  special  equipment  and  crew  requirements,  missing  status  board 
updates,  error  detection  and  correction,  dealing  with  civilian  and  overseas 
MTFs,  and  managing  complicated  secondary  disruptions. 

Third,  these  are  actual  critical  incidents  that  were  observed  in  real  time. 
Critical  incident  analysis  has  been  recognized  as  an  effective  technique  to 
explore  cognitive  aspects  of  performance  in  non-routine  events  (Flanagan,  1954; 
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Klein,  Calderwood  &  MacGregor,  1989;  Shattuck  &  Woods,  1994).  Generally, 
critical  incident  investigations  rely  on  practitioner's  recollection  of  past  events. 

In  this  case  however,  flie  critical  incidents  were  actually  witnessed  by  the  author 
who  is  an  Air  Force  officer  as  weU  as  a  specialist  in  cognitive  engineering.  The 
observer's  experience  provided  both  a  familiarity  with  the  organizational  culture 
and  the  abiUty  to  recognize  subtle  cognitive  components  inherent  in  the  process. 

Although  this  research  focuses  on  three  particular  non-routine  cases,  it  is 
important  to  remember  that  these  cases  did  not  occur  in  isolation.  Normal 
procedures,  activities  and  operations  continued  to  occur  and  provide  the  ever 
important  context  in  which  these  incidents  took  place.  Examining  these  cases  in 
context  is  the  only  way  to  fuUy  understand  and  appreciate  the  complexity  of  the 
event-driven  replanning  process. 

In  addition,  it  is  important  to  keep  in  mind  that  altiiough  some  of  the 
demands  and  strategies  documented  in  these  cases  may  be  unique  to 
aeromedical  evacuation  in  a  peacetime  environment,  the  cognitive  activities 
involved  are  fimdamental  to  the  event-driven  replanning  process  and  hence  can 
be  applied  to  other  dynamic  scheduling  and  planning  domains.  As  such,  the 
information  gained  through  the  examination  of  these  cases  can  be  used  to  build  a 
cognitive  model  of  event-driven  replanning  that  can  sustain  domains  such  as 
airline  dispatching  and  manufacturing  processes  as  weU. 

The  next  three  sections  in  this  chapter  will  walk  through  the  details  of 
each  of  the  three  cases.  A  brief  description  of  each  case  is  provided  along  with 
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the  associated  detailed  protocol  and  a  brief  discussion  of  tihe  interesting 
observations. 

5.2  Case  1:  Urgent  Patient  at  a  Civilian  Hospital 
5.2.1.  The  Context 

It  was  a  Tuesday  afternoon,  approximately  1530  CST.  The  day  had  been 
extremely  hectic.  Severe  thunderstorms  and  tornado  reports  had  forced  the 
cancellation  of  2  of  the  4  scheduled  flights  for  that  day.  The  DO  had  been  very 
busy  trying  to  reschedule  patients  whose  flights  had  been  canceled.  The  FCC 
had  spent  a  lot  of  time  on  the  phone  with  several  AEO  s  across  the  country 
trying  to  help  them  troubleshoot  problems  with  the  DMRES.  A  partial  shift 
change  had  occurred  at  1500.  The  day  shift  DO  was  replaced  by  an  evening  shift 
DO.  The  normal  daytime  complement  of  three  controllers  were  replaced  by  the 
standard  evening  complement  of  one  controller.  The  DO  was  reviewing  the 
itineraries  of  the  rescheduled  patients  and  the  FCC  was  out  of  the  room  when 
the  Urgent  call  was  received. 

5.2.2  The  Urgent  Call 

An  Urgent  call  from  an  AEC  at  Keesler  Air  Force  Base  in  Biloxi, 
Mississippi  at  approximately  1530.  The  locations  of  all  of  the  participants 
involved  in  this  case  are  located  in  Figure  4.  A  civilian  emergency  room  in 
Louisiana  had  a  kidney  disease  patient  reporting  burning  pain  in  his 
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st3omach("hot  belly")  and  a  fever.  The  patient  was  a  medically  retired  Navy  male 
in  his  late  thirties.  He  had  had  a  kidney  transplant  2  year’s  prior  and  was 


Belleview,  IL 
GPMRC  CP 

FCC  DO  CTL  ir 


Figure  4.  Location  of  Participants  in  Case  1.  The  call  came  from  the  AEC  at 
Keesler  AFB  in  Biloxi,  MS.  The  patient  was  located  just  outside  of  New  Orleans, 
LA.  The  destination  medical  treatment  facihfy  was  Wilford  Hall  hospital  in  San 
Antonio,  TX.  GPMRC,  which  is  co-located  with  CP  at  Scott  AFB  in  Belleville,  IL, 
orchestrated  the  replanning  and  patient  movement  The  MCD  was  on  the 
Aircraft  #526  that  diverted  to  transport  the  patient 
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currentiy  taking  an  experimental  drug.  "Hot  belly"  is  a  possible  indication  of 
kidney  rejection  or  abdominal  infection  possibly  caused  by  the  experimental 
drug.  The  AP  specified  patient  transport  to  Wilford  Hall  Medical  Center  in  San 
Antonio,  Texas  because  the  physicians  there  were  familiar  with  the  patient's 
case.  The  AP  had  made  arrangements  with  a  physician  at  Wilford  Hall  to  accept 
the  patient 

5.2.3  Protocol  for  Case  1  (presented  on  the  following  pages) 
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5.2.4  Interesting  Observations 

5.2.4.1  Intermingled  Roles  and  Apparent  Closures 

One  interesting  aspect  to  note  immediately  was  that  the  roles  of  the  FCC 
and  DO  were  very  intermingled.  Since  the  FCC  was  out  of  the  room  when  the 
call  came,  the  DO  assumed  the  role  of  the  FCC.  When  the  FCC  came  back  into 
the  room  and  fotmd  the  DO  on  the  phone  with  the  Urgent  call,  he  began 
generating  options  to  transport  the  patient,  thus  assuming  some  of  the  role  of  the 
DO.  This  may  have  contributed  to  some  of  the  confusion  associated  with  the 
"apparent  closures"  noted  in  the  protocol.  Apparent  closures  occurred  when  the 
participants  beheved  they  had  satisfied  the  goals  or  subgoals,  only  to  reopen 
them  at  a  later  time.  In  most  cases,  goals  or  subgoals  were  reopened  as  a  result 
of  new  information  coming  in  as  the  event  progressed.  liowever,  on  several 
occasions  during  this  protocol,  participants  were  distracted  and  lost  track  of 
issues,  forcing  previously  closed  goals  and  subgoals  to  be  revisited.  The 
intermingUng  of  the  roles  and  responsibilities  of  the  primary  participants  may 
have  contributed  to  the  distractions  and  confusions  as  both  the  FCC  and  the  DO 
tried  to  share  and  accomplish  each  others  tasks  outside  of  their  principal 
operating  domains. 

5.2.4.2  Responsibility /Authority  Issues 

Another  interesting  occurrence  during  this  protocol  was  the 
responsibility/ authority  double  bind  with  respect  to  the  Validation  process.  The 
Validation  process  requires  medical  knowledge,  aerospace  physiology 
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knowledge,  knowledge  of  the  rules  and  procedures  in  the  AE  system,  and 
finally  knowledge  of  how  others  use  and  abuse  the  system.  Whenever  there  are 
doubts  about  the  patient' s  condition  and  the  appropriate  methods  to  deal  with 
those  condition,  the  issue  can  be  bumped  up  the  chain  of  command  for  higher 
level  consultation.  It  appeared  that  the  FCC  was  unsure  of  his  authority  but 
hesitant  to  seek  advice  at  a  higher  level.  He  eventually  did  confer  with  the  flight 
surgeon  after  he  had  aU  of  the  pieces  of  the  revised  plan  in  place. 

5.2.4.3  Information  Comes  in  Over  Time 

An  issue  that  significantly  contributed  to  the  number  of  apparent  closmes 
was  the  fact  that  information  emerged  over  time.  The  DO  and  FCC  immediately 
began  to  devise  a  plan  based  on  the  limited  information  obtained  from  the  AEC. 
Later,  new  information  from  the  AP  prompted  significant  changes  to  the  event- 
driven  replaiming  approach.  As  the  planning  process  continued  to  progress, 
new  information  about  secondary  disruptions  prompted  additional  revisions  to 
the  planning  approach. 

5.2.4.4  Managing  MtJtiple  Threads 

Members  of  the  GPMRC  spent  a  lot  of  time  coordinating  the  activities 
required  to  transport  the  Urgent  patient  and  manage  those  patients  disrupted  by 
diverting  the  aircraft.  GPMRC  members  had  to  coordinate  with  several  outside 
organizations  to;  arrange  groimd  transportation  at  pick-up  and  drop-off  points, 
get  clearance  to  land  at  a  civilian  airfield,  and  accommodate  the  patient  that  was 
supposed  to  be  dropped  off  at  Shaw  AFB.  Team  members  managed  these 
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various  threads  as  they  attended  to  the  daily  routine  activities  that  continued  to 
occur.  These  various  pieces  of  the  proposed  plan  had  to  come  together  in  order 
to  devise  and  enact  the  overall  revised  plan. 

5.2.4.5  Conflictine  Assessments  and  Goals 

The  primary  events  in  this  case  centered  on  the  conflicting  assessment  of 
the  patient s  secondary  cardiac  condition.  Initially,  the  AP  informed  the  DO  that 
the  patient  was  on  a  heart  monitor.  The  DO  went  on  to  explain  that  aeromedical 
evacuation  protocol  requires  a  cardiac  trained  medical  attendant  accompany  any 
patient  on  a  heart  monitor.  As  a  result,  satisfying  the  heart  monitor  requirement 
would  delay  picking  up  the  patient  by  as  much  as  four  hours.  Although  both 
the  FCC's  and  the  AFs  ultimate  goal  was  to  provide  for  the  patient's  welfare, 
they  adopted  different  approaches  to  satisfy  that  goal.  To  the  AP,  taking  care  of 
the  patient  meant  getting  him  to  a  more  suitable  treatment  facility  as  soon  as 
possible.  To  the  FCC,  taking  care  of  the  patient  meant  providing  the  required 
medical  attendants  and  necessary  equipment  to  provide  suitable  in-transit 
patient  care.  As  such,  their  approaches  were  in  conflict  as  the  AP  sought  to 
move  the  patient  out  of  his  hospital  while  the  FCC  sought  to  keep  the  patient  at 
the  originating  hospital  until  he  could  arrange  the  required  equipment  and 
medical  attendants. 

5.2.4. 6  The  Need  for  Negotiation 

The  AP  quickly  realized  the  need  to  negotiate  in  order  to  have  the  patient 
transported  as  soon  as  possible.  He  responded  by  down  playing  the  significance 
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of  the  cardiac  condition  in  relation  to  the  patient's  primary  kidney  condition. 

The  AP  eventually  eliminated  the  requirement  for  tihe  heart  monitor  thereby 
relaxing  the  constraint  to  provide  a  cardiac  attendant  The  AP  was  obviously 
frustrated  as  he  tried  to  convey  the  insignificance  of  the  patient s  cardiac 
condition  with  respect  to  the  immediate  criticality  of  the  patient's  kidney 
condition.  The  FCC  explained  that  the  civilian  AF s  obvious  frustration  was 
probably  caused  by  his  tmfamiharity  with  the  rules  and  operation  of  the  military 
aeromedical  evacuation  system.  A  particular  sticking  point  for  many  physicians 
is  that  nurses  nm  the  mihtary  aeromedical  evacuation  system.  Sometimes  it  is 
difficult  for  physicians  to  acquiesce  to  the  instructions  of  nurses.  As  such, 
physicians  can  sometimes  appear  uncooperative.  Being  aware  of  this  potential 
difficulty,  the  FCC  uses  various  methods  to  work  arotmd  these  difficulties  when 
they  arise.  One  method  the  FCC  uses  to  obtain  required  information  is  to  bump 
the  issue  up  to  the  flight  surgeon  for  a  physician  to  physician  consultation.  The 
other  method,  which  was  used  in  this  case,  is  to  consult  directly  with  the 
attending  nurse.  The  FCC  commented  that  nurses  are  more  inclined  to  give 
fellow  nurses  the  information  they  need  to  adequately  perform  their  jobs. 

The  FCC  called  the  originating  MTF  and  asked  to  speak  with  the 
attending  ER  nurse  to  obtain  additional  information  about  the  patient's  cardiac 
condition.  The  attending  nurse  informed  the  FCC  that  the  patienf  s  cardiac 
condition  was  worse  than  what  the  AP  had  indicated.  The  attending  nurse 
recommended  having  a  heart  monitor.  The  FCC  had  a  dilemma  on  his  hands. 
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His  response  to  the  dilemma  was  to  apprise  the  MCD  of  the  situation,  and  let  her 
decide  how  to  proceed. 

5.2.4.7  Inaccurate  Status  Information 

This  case  also  provided  an  example  of  the  potential  ramifications  of 
inaccurate  information  when  status  systems  are  not  updated  in  a  timely  maimer. 
Because  the  day  shift  controller  had  neglected  to  update  the  mission  status  board 
with  regard  to  the  patient  load  at  Shaw  AFB,  the  FCC  and  DO  beheved  they  had 
a  transportation  requirement  there.  As  such,  the  FCC  and  DO  tried  to  devise -a 
revised  plan  that  would  accommodate  the  Urgent  patient  and  satisfy  the 
secondary  constraint  of  transporting  the  Special  patient  at  Shaw  AFB.  This  error 
prompted  consideration  of  a  constraint  that  was  not  pertinent  in  this  situation. 
This  precipitated  several  apparent  closures  as  the  GPMRC  crew  gradually 
determined  the  true  status  of  the  patient  requirements  at  Shaw  AFB  over  time. 

5.2.5  Results  of  an  Expert  Review  of  the  Protocol 

This  case  was  later  reviewed  and  critiqued  by  an  expert  FCC  with  more 
than  nine  years  aeromedical  evacuation  experience.  He  had  worked  as  an  FCC 
in  Desert  Storm  and  had  spent  several  years  in  Europe  and  the  Middle  East.  The 
expert  concurred  with  the  FCC's  and  the  DO' s  initial  strategy  to  send  a  separate 
aircraft  and  avoid  disrupting  the  plan  in  progress.  He  pointed  out  that  although 
this  is  the  easiest  solution,  it  also  usually  the  most  costly.  However,  the  expert 
could  not  understand  why  the  participants  in  Case  1  started  arranging 
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transportation  right  away.  He  stated  that  the  first  order  of  business  should 
always  be  to  obtain  as  much  information  as  possible  on  the  patient' s  condition. 
The  expert  was  amazed  to  see  that  the  participants  did  not  obtain  information  on 
the  patienf  s  status  rmtil  they  were  well  into  the  replanning  process.  This 
prompted  the  expert  to  inquire  about  the  experience  levels  of  the  FCC  and  the 
DO.  He  went  on  to  explain  why  the  participants  on  duty  during  this  episode 
might  have  jumped  the  gun  and  starting  arranging  transport  before  they  had  a 
clear  picture  of  the  patienT s  condition.  He  noted  that  practitioners  who  have  not 
worked  in  crisis  situations  (i.e.  Grenada,  Operation  Dessert  Storm,  Bosnia 
peacekeeping  missions)  tend  to  get  very  excited  and  overreact  when  an  urgent 
situation  arises.  Novices  in  these  situations  tend  to  think  they  have  to  do 
everything  "right  awa}/'.  They  don't  stop  to  think  that  the  extra  5-10  minutes  it 
might  take  to  obtain  additional  information  won't  jeopardize  the  situation  and 
will  probably  save  them  much  more  time  in  the  long  run.  The  expert  went  on  to 
say  that  it  is  up  to  the  FCC  to  take  charge  and  orchestrate  the  replaiming  process. 
Personahty  or  experience  level  might  explain  why  the  FCC  on  duty  that  evening 
did  not  efficiently  control  the  replanning  activity.  Had  there  been  more  central 
control  and  appointed  responsibilities,  they  may  not  have  experienced  as  much 
difficulty  reaching  closure  on  secondary  disruptions. 
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5.3  Case  2:  Urgent  Patient  Outside  CONUS 

5.3.1  Vie  Context 

The  day  shift  was  barely  underway  when  the  call  came  into  the  GPMRC 
at  approximately  0730  CST  on  a  Wednesday  morning.  The  DO  had  been  on 
duty  for  an  hour  and  the  rest  of  the  GPMRC  crew  including  the  FCC  had  been 
on  duty  for  approximately  thirty  minutes. 

5.3.2  The  Urgent  Call 

The  patient  was  an  Air  Force  active  duty  reserve  officer  in  his  early 
forties.  He  was  participating  in  a  training  exercise  in  Haiti  when  he  began 
experiencing  chest  pain.  The  patient s  cardiac  enzymes  were  elevated  and  the 
cardiac  monitor  showed  sinus  rhythm  at  a  rate  of  40-60  beats  per  minute  and 
minimal  PVC's.  The  AP  at  the  field  hospital  started  a  lydocaine  drip.  The  field 
hospital  was  a  minimal  care  treatment  facility  and  was  xmable  to  provide 
treatment  beyond  what  they  were  currently  doing.  They  did  not  possess  the 
equipment  to  conduct  further  tests  to  determine  the  nature  of  the  patient s 
cardiac  problems.  The  AP  knew  the  patient  needed  care  beyond  the  capability 
of  the  field  hospital  in  Haiti  but  he  did  not  have  a  suitable  destination  MTF  or 
receiving  physician  set  up  or  in  mind  when  he  placed  the  call  to  the  GPMRC. 
The  locations  of  all  of  the  participants  involved  in  this  case  are  displayed  in 
Figure  5. 
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Belleview,  IL 
GPMRC  CP 

FCC  DO  CTL  I  I 


Figxire  5.  Location  of  Participants  in  Case  2.  The  patient  was  located  at  a  field 
hospital  in  Haiti.  The  destination  medical  treatment  facility  was  Ft  Gordon 
hospital  in  San  Augusta,  GA.  The  MCD  was  enroute  to  Maxwell  AFB  on 
Aircraft  #226. 


5.3.3  Protocol  for  Case  2  {presented  on  the  follaioing  pages) 
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5.3.4  Interesting  Observations 

5.3.4.1  Patient  Located  Outside  the  CONUS 

This  case  had  many  interesting  twists.  First,  the  originating  MTF  was  in 
Haiti.  Typically,  the  aircraft  and  aircrew  located  at  GPMRC  are  only  responsible 
for  transporting  patients  within  their  theater  of  operation  (i.e.  the  continental 
United  States).  The  TACC,  on  the  other  hand,  is  responsible  for  transporting 
patients  between  theaters  of  operation.  Consequently,  when  the  Urgent  call  came 
in,  the  DO  immediately  contacted  the  TACC.  When  the  DO  learned  that  the 
TACC  did  not  have  any  aircraft  available  in  the  vicinity,  he  asked  them  to 
contact  training  squadrons  that  would  be  able  to  respond  in  a  timely  manner. 
TACC  did  find  a  training  squadron  that  wanted  to  take  the  mission.  In  the  end 
however,  the  training  squadron  could  not  support  the  mission.  What  was  also 
interesting  here  was  that  when  the  DO  handed  off  the  coordination  of  transport 
to  TACC,  there  was  a  lot  of  "dead  time"  as  GPMRC  crew  members  waited  for 
updates  from  the  TACC.  In  fact,  it  took  over  two  hours  to  implement  a  revised 
plan  to  deal  with  the  disrupting  Urgent  call  in  this  case.  There  were  three 
prominent  time  lags  that  contributed  to  the  long  planning  process.  First,  there 
was  dead  time  while  the  DO  waited  for  the  TACC  to  determine  their  ability  to 
support  the  mission.  Then  there  was  a  substantial  time  lag  while  the  TACC  was 
trying  to  locate  a  training  squadron  that  might  be  able  to  support  the  mission. 
Finally,  there  was  another  significant  time  lag  while  the  training  squadron 
considered  their  abiHty  to  support  the  mission.  During  these  time  lags  however. 
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the  DO  did  lightly  consider  his  options  in  the  event  that  the  GPMRC  had  to 
provide  the  transport  The  DO  knew  that  Haiti  was  just  a  couple  of  hours  off  the 
coast  of  Florida.  He  also  knew  from  previous  experience  that  hiring  a  Civil  Air 
Ambulance  would  be  too  costly.  Flying  a  smaller  C-21  aircraft  was  never  an 
option  because  they  are  not  equipped  to  fly  over  water. 

5.3.4.2  Arrange  Destination  MTF 

Another  unique  aspect  of  this  case  was  the  fact  that  the  FCC  had  to  find  a 
destination  MTF  and  a  RP.  The  FCC  wanted  to  transport  the  patient  to  the 
closest  hospital  with  the  capability  to  care  for  the  patient  When  the  FCC  input 
the  patient  s  data  into  the  DMRIS  to  locate  a  hospital  with  the  closest  capability, 
it  came  back  with  Walter  Reed  hospital  which  is  just  outside  of  Washington,  DC 
This  was  unacceptable  to  the  FCC  because  she  knew  there  were  hospitals  closer 
to  Haiti  that  could  provide  the  care  that  the  patient  needed.  She  knew  Ft 
Gordon  had  a  cardiac  facility  that  could  perform  the  appropriate  tests  to 
determine  the  patient's  condition. 

5.3.4.3  Compelline  Secondary  Disruption 

Perhaps  the  most  engaging  aspect  of  this  case  was  that  a  secondary 
disruption  shaped  the  replanning  process  as  much  as  the  primary  disrupting 
event.  The  initial  revised  plan  was  structured  around  picking  up  and  delivering 
the  Urgent  patient  in  the  most  expeditious  manner.  The  diverted  aircraft  was  to 
proceed  to  Haiti,  pick  up  the  Urgent  patient,  transport  the  patient  to  Ft  Gordon, 
and  then  resume  the  previous  mission  itinerary.  When  the  FCC  informed  the 
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MCD  of  the  proposed  plan,  the  MCD  objected  based  on  the  deteriorating  status 
of  a  patient  on  the  aircraft.  The  FCC  did  know  that  there  was  a  Special,  do  not 
resuscitate  (DNR)  patient  onboard,  but  she  did  not  know  that  the  patienTs 
condition  had  deteriorated,  otherwise  she  would  have  factored  that  information 
into  the  replanning  process.  The  MCD  explained  that  she  was  reluctant  to  take 
the  patient  in  the  first  place  and  she  wasn't  sure  the  patient  would  make  the  trip 
to  Haiti  and  back.  The  FCC  and  the  MCD  discussed  the  consequences  of  the 
DNR  patient  arresting  and  dying  enroute  to  Haiti.  If  this  happened,  regulation 
required  that  the  medical  crew  on  board  the  aircraft  off-load  the  body  at  the  next 
stop.  They  did  not  want  to  risk  having  to  leave  the  patienT s  body  in  Haiti.  In 
the  end,  the  FCC  convinced  the  DO  and  CP  to  revise  the  proposed  plan  to  drop 
the  DNR  patient  off  before  going  to  Haiti. 

5.3.4.4  Apparent  Closures 

Several  apparent  closures  occurred  during  the  event-driven  replanning 
process  for  this  case.  Most  of  the  apparent  closures  were  the  result  of  new 
information  coming  into  the  GPMRC.  When  the  TACC  reported  that  they  formd 
a  training  squadron  that  wanted  to  take  the  mission,  GPMRC  members  believed 
they  had  a  mode  of  transportation  so  tiKey  were  no  longer  looking  for  opportune 
aircraft  or  planes  to  divert.  When  the  training  squadron  came  back  later  and 
declined  the  mission,  GPMRC  crew  members  had  to  reinitiate  their  search  for  a 
mode  of  transportation. 
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The  second  apparent  closure  occurred  when  the  DO  and  CP  devised  a 
proposed  plan  to  transport  the  Urgent  patient  based  on  the  information  at  hand. 
When  the  MCD  heard  the  proposed  plan,  she  provided  additional  information 
that  prompted  the  DO  and  CP  to  modify  the  itinerary  of  the  proposed  plan. 
Unfortunately,  by  the  time  the  divert  aircraft  landed  at  Maxwell  APB  and  the 
MCD  was  instructed  to  call  back  to  the  GPMRC,  the  proposed  plan  was  already 
established. 

The  third  apparent  closure  occurred  when  the  FCC  fotmd  a  medical 
attendant  to  care  for  the  patient  during  flight  Later  she  realized  that  the 
medical  attendant  would  not  be  able  to  accompany  the  patient  to  the  hospital 
because  of  crew  duty  day  considerations.  As  a  result,  she  had  to  arrange  to  have 
a  medical  attendant  meet  the  aircraft  to  provide  continuous  patient  care  from  the 
aircraft  to  the  medical  treatment  facility. 

5.3.4.5  Lookine  Ahead 

Members  of  the  GPMRC  continually  looked  ahead  to  anticipate  potential 
problems  and  actions  that  might  arise  in  the  future.  For  instance,  when  the  DO 
began  planning  to  divert  Flight  #226,  he  projected  that  the  crew  would  have  to 
take  on  extra  fuel  before  flying  to  Haiti.  He  also  considered  that  the  plane 
would  have  to  clear  customs  when  it  returned  from  Haiti,  so  he  wanted  to  bring 
the  plan  back  into  an  airfield  that  would  allow  them  to  clear  customs  easily. 
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5.3.4.6  Planning  Strategies 


This  case  highlights  several  different  planning  strategies.  The  FCC 
utilized  an  opportunistic  strategy  when  she  looked  at  the  qualifications  of  the 
medical  crew  and  foimd  a  Standard-Evaluation  officer,  who  was  on  board 
administering  a  check-ride,  was  ACTS  qualified.  The  DO  displayed  a  case- 
based  planning  strategy  when  he  was  able  to  immediately  rule  out  hiring  a 
Civilian  Air  Ambxriance  based  on  a  previous  experience  similar  to  the  situation 
at  hand.  In  addition,  this  case  highlights  the  drawbacks  of  employing  a  strictly 
depth-first  approach  to  the  event-driven  replanning  process  and  the 
disadvantages  of  having  to  proceed  with  the  planning  process  when  information 
is  incomplete.  Employing  a  depth  first  and  abstraction  hierarchy  approach 
proved  costly  when  planners  realized  that  the  "details"  (i.e.,  secondary 
disruptions)  were  as  critical  as  the  primary  problem. 

5.4  Case  3:  Equipment  Problems 

5.4.1  The  Context 

It  was  a  calm  Thursday  morning,  approximately  1030  CST.  The  crew  at 
GPMRC  had  been  on  duty  for  several  hours.  The  FCC  was  reviewing  the 
medical  and  equipment  requirements  of  ongoing  missions.  The  DO  was 
monitoring  the  progress  of  ongoing  missions. 
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5.4.2  The  Situation 


While  reviewing  the  equipment  requirements  for  ongoing  missions,  the 
FCC  noticed  that  a  patient  with  seizures  and  a  temporary  pacemaker  was 
scheduled  to  fly  on  a  C-21  later  that  morning.  Realizing  an  external  pacemaker' s 
potential  for  causing  electro-magnetic  interference  (EMI)  on  the  aircraft,  the  FCC 
called  the  AP  at  the  originating  MTF.  The  AP  explained  that  it  was  an  internal 
pacemaker  and  hence  would  not  pose  a  problem.  The  AP  then  went  on  to  ask  if 
he  could  substitute  a  Pack  9  (style/ model  of  cardiac  monitor)  for  a  Pack  8 
because  he  was  unable  to  locate  a  Pack  8  an5rwhere  in  the  Colorado  Springs  area. 
The  FCC  told  the  AP  that  neither  Pack  was  authorized  on  a  C-21  aircraft  The 
AP  angrily  relayed  that  his  people  had  spent  the  entire  morning  trying  to  locate 
the  Pack  8  which  had  been  approved  by  someone  at  GPMRC.  An  error  had  been 
made.  The  AP  informed  the  FCC  that  the  patient  was  to  be  transported  in 
approximately  2  hours.  The  FCC  set  out  to  find  what  type  of  monitor  would  be 
acceptable  on  a  C-21. 

5.4.3  Protocol  for  Case  3  (presented  on  the  following  pages) 
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5.4.4  Interesting  Observations 
5.4.4.1  An  Error  was  Made 


In  this  case,  the  imanticipated  event  resulted  from  an  error  made  by 
someone  in  tihe  GPMRC.  The  FCC  from  the  previous  shift  had  mistakenly 
cleared  the  use  of  unauthorized  equipment  on  the  C-21.  It  is  unclear  whether  the 
FCC  failed  to  read  or  misread  the  guidelines  on  acceptable  equipment  that  are 
located  in  a  binder  on  a  shelf  directly  behind  the  FCC's  desk.  Another 
explanation  might  be  that  the  FCC  mistakenly  believed  she  had  the  authority  to 
clear  equipment  onboard  aircraft  Luckily  the  problem  was  caught  prior  to  the 
schedided  transport 

The  FCC  immediately  informed  the  commander  of  the  GPMRC  and  the 
SG  to  make  them  aware  of  the  problem.  Since  the  GPMRC  caused  this 
unanticipated  event,  the  entire  chain  of  command  was  anxious  to  resolve  the 
situation  as  quickly  as  possible.  An  additional  complicating  factor  was  that  the 
aircraft  scheduled  to  transport  the  patient  was  not  owned  by  GPMRC.  The  FCC 
from  the  previous  shift  had  arranged  the  transport  with  a  unit  out  of  Peterson 
AFB,  CO.  As  such,  the  chain  of  command  at  the  GPMRC  was  very  concerned 
about  tarnishing  their  reputation.  They  were  worried  about  future  interactions 
with  physicians  at  the  Air  Force  Academy  and  future  support  from  the  unit  out 
of  Peterson.  A  senior  FCC  was  called  into  the  control  room  to  oversee  the  event- 
driven  replanning  process.  The  senior  FCC  took  control  of  the  situation  when 
the  FCC  on  duty  went  to  Ixmch. 
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5.4.4.2  Negotiation 


Negotiation  played  a  key  role  in  the  resolution  of  this  event-driven 
replanning  process.  The  FCCs  who  worked  this  case  were  very  much  aware  of 
the  fact  that  they  had  to  come  up  with  a  solution  that  the  AP  would  find 
acceptable.  They  knew  that  the  AFs  feathers  were  ruffled  and  they  would  have 
to  appease  him.  The  FCC  quickly  began  to  generate  options  to  resolve  this 
problem.  They  determined  what  they  considered  to  be  the  best  course  of  action 
and  subsequently  went  on  to  convince  the  AP  of  the  same. 

5.4.4.3.  Managing  Multiple  Threads 

The  senior  FCC  who  took  over  when  the  FCC  on  duty  went  to  Itmch  was 
extremely  adept  at  handling  multiple  threads  of  activity.  She  assigned  tasks  and 
orchestrated  the  coordination  required  to  have  several  plans  in  place  at  one  time. 
She  demanded  timely  updates  on  the  tasks  that  she  assigned  and  provided 
continuos  feedback  to  everyone  involved  in  the  planning  process. 

5.4.4.4  Planning  Strategies 

The  planning  approach  taken  in  this  case  was  primarily  breadth  first.  The 
FCC,  with  the  help  of  the  GPMRC  commander  and  the  SG,  generated  three 
options: 

1) See  if  AP  will  waive  the  monitor  requirement  during  critical  phases  of 
flight  (This  would  also  require  getting  the  C-21  flight  crew  to  accept  having  the 
monitoring  on  during  non-critical  phases  of  flight) 

2) Divert  Flight  #666,  and  see  if  AP  will  accept  the  patient  staying  over 
night  at  Scott  AFB  with  delivery  to  the  destination  MTF  the  following  day 
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3)Call  the  Critical  Care  Team  in  San  Antonio  and  see  if  they  can  support 
the  mission. 

The  FCC  coordinated  all  three  options.  She  had  the  Critical  Care  team  in 
San  Antonio  on  standby,  she  had  coordinated  the  accommodations  for  the 
patienT s  stay  at  Scott  AFB,  and  had  the  staff  at  the  ASTF  on  standby  to  receive 
the  patient  Once  the  AP  agreed  to  one  of  the  options,  the  GPMRC  team  would 
be  ready  to  initiate  the  revised  plan. 

Recognition/Case  based  planning  was  also  evident  when  the  DO  recalled 
a  previous  experience  to  explain  how  to  split  the  refueling  stops  to  avoid  being 
too  “h&icvy"  to  takeoff  out  of  Colorado  Springs. 

Ajiother  interesting  thing  to  note  about  this  case  was  that  of  the  three 
options  generated,  the  members  of  the  GPMRC  preferred  the  option  that  would 
disrupt  the  plan  in  motion.  This  is  contrary  to  planners'  normal  option  selection. 
Perhaps  it  was  because  they  felt  responsible  for  the  unanticipated  event,  and 
hence  felt  the  need  to  take  care  of  the  problem  themselves. 

5.4.4.5  Relaxine  Constraints 

Relaxing  constraints  played  significant  roles  in  the  event-driven 
replanning  process  of  this  case.  Two  of  the  options  that  the  FCC  presented  to  the 
AP  involved  constraint  relaxation.  The  first  option  called  for  relaxing  the 
constraint  for  the  cardiac  monitor.  The  second  option  relaxed  the  constraint  to 
deliver  the  patient  to  the  destination  MTF  that  day. 
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CHAPTER  6 


DISCUSSION 


6.1  Introduction 

Interesting  themes  emerged  while  developing  and  analyzing  the  protocols 
from  the  three  cases  presented  in  this  research.  The  analysis  revealed  several 
fascinating  and  unexpected  findings  that  could  have  major  implications  for  the 
design  of  systems  to  support  the  event-driven  replanning  process 

First,  planners  used  multiple  strategies  to  develop  and  refine  plans  in 
response  to  emerging  constraints.  Constraint  identification  and  management 
drove  the  event-driven  replaiming  process.  Event-driven  replanning  is,  by 
nature,  situated  planning,  but  the  results  of  this  research  revealed  that  plaimers 
also  employed  opportunistic,  case-based,  and  hierarchical  planning  strategies 
during  the  replaiming  process.  Event-driven  replanning,  as  observed  in  the 
aeromedical  evacuation  domain,  utilized  aspects  of  case  based  planning 
whereby  planners  did  not  replan  from  scratch,  rather,  they  utilize  portions  of 
plans  encoded  in  memory  that  possessed  characteristics  that  were  similar  to  the 
situation  at  hand.  Planners  relied  on  recognition  and  case-based  strategies  to 
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assess  situations  and  select  courses  of  action.  In  addition,  planners  used 
primarily  a  depth  first  approach  to  replan  activities  to  accommodate  the 
disrupting  event  Planners  latched  onto  the  first  option  that  showed  promise  of 
handling  the  disrupting  event,  disregarding  the  potential  ramifications  that 
would  ensue  as  a  result  of  reaUocating  committed  resoxtrces. 

The  second  significant  finding  uncovered  dxuing  this  research  was  that 
information  coming  in  over  time  and  multiple  threads  created  apparent  closures 
that  forced  planners  to  reopen  and  revisit  tasks  that  had  been  previously  closed 
or  dealt  with.  Information  coming  in  over  time  compoxmds  the  complexity  of 
event-driven  replanning  because  it  affects  many  aspects  of  the  replanning 
process.  New  information  coming  in  over  time  was  the  primary  cause  of 
apparent  closures  in  the  event-driven  replanning  process.  As  new  information 
comes  in,  it  must  be  folded  into  the  event-driven  replanning  process.  Very  often 
however,  this  new  information  changes  the  status  of  tasks  by  changing  the 
priority  of  constraints.  Consequently,  tasks  that  were  previously  completed  or 
close  to  completion  may  have  to  be  reopened  or  redirected  based  on  the 
constraints  and  demands  revealed  by  new  information.  Information  coming  in 
over  time  continually  changes  the  nature  of  constraints  the  plarmers  faced.  As  a 
result,  plaimers  do  not  have  the  luxury  of  a  standard  set  of  constraints  on  which 
to  devise  workable  solutions  to  disrupting  events  in  the  early  stages  of  the 
replanning  process. 
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The  second  cause  of  apparent  closures  was  multiple  threads  that  went  on 
in  parallel.  Event-driven  replanning  is  a  complex  process  that  requires 
coordinating,  tracking,  and  managing  multiple  tasks,  subtasks,  issues  and 
related  activities.  Adding  to  this  complexity  is  the  fact  that  the  data  and  the 
knowledge  required  to  perform  these  tasks,  issues,  and  activities  resides  with 
different  individuals  who  are  either  functionally  or  spatially  distributed. 

Adding  still  more  layers  of  complexity,  are  the  facts  that  individuals  may  handle 
multiple  tasks  issues  and  activities  and  these  tasks,  issues  and  activities  can  be 
distributed  across  multiple  individuals.  When  multiple  people  are  handling 
multiple  tasks  to  achieve  one  goal,  it  is  not  surprising  that  sometimes  tasks  are 
dropped,  disappear,  and  reemerge  resulting  in  apparent  closures. 

The  third  significant  finding  was  that  planners  relied  on  negotiation  as  a 
means  to  deal  with  constraints.  Constraint  identification  and  relaxation  are 
critical  aspects  of  the  event-driven  replanning  process.  Planners  must  identify 
constraints  that  may  obstruct  the  current  planning  path  and  limit  their  ability  to 
complete  the  plan.  Once  constraints  are  identified,  planners  attempt  to  relax  the 
constraints  via  negotiation  with  the  party  responsible  for  that  constraint  Hence, 
negotiation  is,  by  nature,  a  cooperative  process.  Constraints  arose  as  a  new 
information  came  in  over  time.  As  new  information  came  in,  plaimers  were 
required  to  identify  the  associated  constraints  and  then  determine  how  to 
manage  those  constraints.  Planners  relied  on  their  knowledge  of  the  procedures, 
operations,  and  rules  of  aeromedical  evacuation  to  assist  in  the  constraint 
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identification  process.  During  the  constraint  management  process  however, 
plaimers  relied  primarily  on  their  experiences  and  their  ability  to  negotiate. 

The  fourth,  and  most  surprising  finding  was  the  tmexpected  discovery 
that  planners  did  not  explicitly  consider  the  impact  of  secondary  disruptions 
when  they  revised  plans  to  accommodate  unanticipated  disrupting  events. 

When  an  unanticipated  event  occurs,  the  planners  implicit  goals  are  to:  1) 
accommodate  the  primary  disrupting  event,  2)  accommodate  the  resultant 
secondary  disruptions,  and  3)  minimize  the  workload  on  the  GPMRC  crew 
members.  What  is  sxirprising  is  that  the  approach  taken  by  planners  does  not 
incorporate  two  out  of  three  of  these  goals.  It  appeared  that  accommodating  an 
Urgent  patient  dominated  other  factors  including  the  workload  needed  to 
manage  secondary  disruptions  and  the  cost  of  change  to  the  less  critical  patients. 
This  absolute  priority  of  Urgent  patients  over  other  factors  may  make 
aeromedical  evacuation  replanning  different  from  other  forms  of  event-driven 
replaiming.  Given  the  costs  associated  with  changing  plans  in  progress,  it  was 
hypothesized  that  planners  would  actively  seek  solutions  that  minimized 
secondary  disruptions.  Instead,  plaimers  approached  the  replanning  process 
with  the  mindset  of  accommodating  the  disrupting  event  as  quickly  as  possible 
without  considering  the  potential  secondary  disruptions  and  resultant  workload 
that  might  ensue.  Planners  pursued  the  first  solution  that  feasibly  handled  the 
primary  disrupting  event  and  opted  to  manage  the  secondary  disruptions  that 
followed. 
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6.2  Event-Driven  Replanning  Strategies 

In  the  realm  of  planning,  numerous  researchers  have  attempted  to  model 
the  planning  process.  Models  of  planning  posit  that  planning  is;  case  based 
(Hammond,  1979),  opportunistic  (Hayes-Roth  &  Hayes-Roth,  1979),  situated 
(Suchman,  1991)  or  hierarchical  (Sarcedoti,  1979;  Hoc,  1988;  Xiao,  1994). 
Observations  made  during  this  research  revealed  that  people  do  in  fact  use 
components  of  all  of  these  approaches  along  with  other  techniques  during  the 
event-driven  replanning  process. 

The  first  strategy  employed  by  plaimers  in  all  three  cases  was  to  try  to 
utilize  uncommitted  resources.  Mission  planners  sought  solutions  that  would 
accommodate  the  unanticipated  disrupting  event  separately,  without  disturbing 
the  plan  in  progress.  Options  they  considered  included;  launching  uncommitted 
resources  or  obtaining  additional  resources  from  other  organizations.  Only 
when  these  options  failed  or  were  not  available,  did  mission  planners  opt  to 
divert  an  aircraft 

Once  the  decision  had  been  made  to  divert  an  aircraft,  planners  identified 
suitable  aircraft  based  on  the  amormt  of  crew  duty  day  remaining  and  the 
relative  proximity  to  the  patient  If  a  plane  had  the  crew  duty  time  available, 
met  medical  and  equipment  requirements,  and  was  reasonably  close  to  the 
patient,  it  became  a  candidate  for  diversion.  Once  planners  identified  a  suitable 
aircraft  for  diversion,  tiiey  embarked  on  a  depth  first  strategy,  seeking  to  commit 
the  candidate  aircraft  without  generating  or  considering  other  suitable  options. 
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Once  committed  to  a  plan  to  accommodate  the  primary  disrupting  event, 
planners  began  to  devise  partial  plan  solutions  based  on  the  information  at 
hand.  They  then  moved  sequentially  through  a  series  of  plan  refinements  as 
new  information  trickled  in  over  time  reveals  impasses  and  new  constraints  that 
threatened  to  render  the  current  solution  infeasible.  When  planners  identified  a 
constraint  that  could  not  be  met,  they  tried  to  manage  the  constraint  by  either 
relaxing  the  constraint  or  modifying  the  plan  at  hand  before  abandoning  it  and 
moving  on  to  consider  a  new  plan.  Since  planners  engaged  in  a  depth  first 
approach  to  replanning,  when  they  met  an  impasse  caused  by  constraints  that 
could  not  be  managed  or  negotiated,  their  only  option  was  to  backtrack  and  start 
the  process  over  again  to  find  another  aircraft  that  could  feasible  accommodate 
the  disrupting  event  (See  Figure  6).  Figure  6  clearly  illustrates  the  depth  first 
strategy  that  planners  employ  in  the  replanning  process  (the  specifics  of  the 
model  will  be  explained  in  detail  in  the  following  sections).  Launching  or 
obtaining  additional  resources  is  the  first  choice  for  planners  because  it  provides 
a  straight,  uncomplicated  path  to  completing  a  plan  to  accommodate  the 
disrupting  event  This  path  totally  avoids  disrupting  the  plan  in  progress. 
However,  if  additional  resources  are  not  available,  it  is  obvious  that  the  depth 
first  approach  leads  planners  down  a  path  that  can  either  lead  quickly  to  plan 
completion,  or  cause  planners  to  back  track.  Planners  can  hit  impasses  very  far 
down  into  the  planning  process  and  be  forced  start  the  process  again. 
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Event  -Driven  Replanning  Process 


Figure  6.  Model  of  the  Event-Driven  Replanning  Process 


Consequently,  the  depth  first  strategy  is  the  fastest  approach  to  successful  plan 


implementation  provided  there  are  no  impasses  or  complications.  Planners'  depth 
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first  strategy  is  a  reasonable  approach  given  the  urgency  and  risks  associated 
with  most  unanticipated  events. 

Planners  initially  relied  on  recognitional  or  case-based  processes  to  select 
the  first  feasible  solution.  When  planners  were  able  to  recall  past  instances  that 
were  similar  to  the  situation  at  hand,  they  were  able  to  make  decisions  and 
devise  plans  more  quickly  and  with  greater  confidence.  When  planners  were 
confronted  with  situations  for  which  they  had  no  reference,  they  would  first 
generate  options  prior  to  making  planning  decisions  or  consult  a  more  senior 
member  for  suggestions  on  how  to  proceed.  Consequently,  it  took  longer  to 
formulate  and  implement  a  plan  when  planners  encountered  novel  situations. 

In  addition,  an  opportunistic  planning  approach  was  clearly  evident 
during  the  event-driven  replanning  process.  As  planners  gathered  information, 
they  were  continually  searching  for  opportunities  to  take  advantage  of  resources 
or  situations  that  would  be  to  their  advantage  in  the  replanning  process. 

6.2.1  Strengths 

Planners  abilities  to  employ  multiple  planning  strategies  to  meet  the 
demands  of  the  situation  at  hand  is  one  of  the  greatest  strengths  of  the  event- 
driven  replanning  processes  observed  during  the  course  of  this  study.  Planners 
were  able  to  switch,  modify,  combine,  or  devise  planning  strategies  when  they 
encountered  bottlenecks  in  the  plaiming  process.  The  advantage  to  such  an 
approach  was  that  constraints  and  demands  did  not  impede  the  planning 
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process.  Planners  remained  constantly  engaged  in  satisfying  constraints  and 
meeting  demands.  They  were  able  to  maintain  a  continuous  flow  of  activity  to 
develop  a  workable  plan  to  deal  with  unanticipated  events  and  their  side  effects. 
As  a  result,  the  human  planner's  approach  to  event-driven  replanning  was  very 
robust  in  the  face  of  the  hard  to  satisfy  constraints  and  the  urgency  of  the 
demands  that  occurred  in  this  complex  and  dynamic  environment  Planners 
sought  satisfactory  solutions  as  opposed  to  optimal  ones. 

6.2.2  Weaknesses 

Although  a  multiple  strategy  approach  does  have  distinct  advantages,  it 
can  become  unwieldy  and  highly  demanding  when  dealing  with  large  scale 
planning  problems.  This  approach  becomes  ineffective  when  planners  must 
search  large  problem  spaces  for  opportunities  or  past  cases  with  similar 
attributes. 

6.2.3  Supporting  a  Multi-Strategy  Approach  to  Planning 

As  previously  stated,  current  automated  planning  systems  have  been 
unsuccessful  in  complex  and  dynamic  environments.  This  may  be  due,  in  part, 
to  their  inability  to  employ  multiple  strategies  to  meet  the  constraints  and 
situations  at  hand.  As  such,  automated  tools  should  support  the  human 
planners  ability  to  employ  multiple  strategies  during  the  event-driven 
replanning  process.  Automated  tools  shoxild  search  and  prune  the  problem 
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space,  characterize  problems  and  constraints,  and  identify  opportunities  and 
relevant  cases  to  augment  the  planners  multi-strategy  approach.  Once  the 
planner  identifies  the  parameters  of  interest,  the  automated  tool  can  search  and 
locate  the  appropriate  information  for  the  planner  to  use  as  he/ she  sees  fit. 

Another  method  to  support  the  recognitional/ case-based  strategy 
specifically  would  be  for  the  GPMRC  crew  to  schedvde  weekly  or  biweekly 
meetings  to  discuss/present  interesting  cases  that  have  occurred  during  that 
time  interval.  Physicians  utilize  this  method  of  learning  in  teaching  hospitals. 
This  would  allow  planners  to  learn  from  the  experiences  of  others  and  increase 
their  recognitional  base. 

6.3  Changing  Information  and  Multiple  Threads  Cause  Apparent  Closures 

Typical  planning  approaches  assume  a  complete  set  of  data  input  at  the 
outset  of  the  planning  process.  In  event-driven  replanning  however,  planners 
must  commence  the  replanning  process  based  on  the  data  at  hand.  As  new 
information  comes  in,  it  must  be  folded  into  the  planning  process  and  evaluated 
for  possible  side  effects.  Very  often  this  new  information  spurs  new  activities, 
creates  new  goals  and  changes  the  mindset  of  the  participants.  Apparent 
closures  generally  resulted  when  new  information  was  injected  into  the  planning 
process.  This  new  information  either  changed  the  status  of  tasks  that  were 
previously  closed,  or  acted  as  triggers  to  revisit  previous  threads. 
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In  addition  to  new  information,  the  presence  of  multiple  activities  that 
intertwined  and  went  on  in  parallel  contributed  to  many  of  the  apparent 
closures  highlighted  in  the  protocols.  A  coherent  line  of  reasoning  or  activity  is 
referred  to  as  a  thread.  Threads  run  throughout  each  episode;  they  start  up,  fade 
away,  and  re-emerge.  Additional  threads  come  in  and  demand  attention  or 
consideration  while  others  are  ongoing. 

Trying  to  keep  track  of  who  is  managing  what  threads  and  the  status  of 
those  threads  can  be  confusing.  The  confusion  stems  not  only  from  the  fact  that 
multiple  people,  distributed  in  various  locations,  must  coordinate  to  manage  the 
threads,  but  also  from  the  fact  that  each  individual  may  be  responsible  for 
managing  several  threads  at  a  time.  As  individuals  jumped  from  one  thread  to 
the  next,  they  lost  situation  awareness  and  had  to  reorient  themselves  to  the 
threads  at  hand.  This  sometimes  created  situations  where  tasks  were  reopened 
after  they  appeared  to  be  closed. 

6.3.1  Weaknesses 

Human  information  processing  capabilities  are  limited.  In  the  cases 
previously  described,  plaimers  had  a  difficult  time  keeping  track  of  the  threads 
associated  with  reacting  to  one  imanticipated  event  with  limited  side  effects.  In 
addition,  plaimers  were  operating  in  a  peacetime  environment  with  relatively 
low  patient  loads  and  abundant  resources.  Imagine  the  number  of  threads  that 
would  be  involved  in  handling  a  mass  casualty  situation  with  multiple  side 
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effects,  in  a  resource  limited  environment.  Plarmers  would  be  saturated  almost 
immediately  as  they  tried  to  manage  and  track  the  various  threads  that  would 
exist  in  such  a  scenario. 

Ultimately,  the  apparent  closures  that  result  from  changing  information 
and  managing  multiple  threads  can  lead  to  plan  degradation,  plan  delay,  or  plan 
failure. 

6.3.2  Supporting  Changing  Information  and  Managing  Multiple  Threads  to  Alleviate 
Apparent  Closures 

To  alleviate  the  potential  problems  associated  with  changing  information 
and  managing  multiple  threads,  a  support  tool  should  assist  planners  by 
providing  a  record  of  incoming  information  and  highlighting  those  threads  that 
are  critical  to  plan  development  or  require  immediate  attention.  In  addition, 
providing  a  central  repository  for  information  can  provide  a  means  for  team 
members  to  know  the  status  of  activities  in  the  planning  process  This  tool  must 
provide  common  visibility  and  access  to  all  participants,  wherever  they  may  be. 
The  tool  should  be  open  and  show  the  constraints  that  have  been  identified  and 
the  status  of  the  process  of  meeting  those  constraints.  In  addition,  it  should 
participants  to  make  annotations  on  the  common  viewing  space.  The  tools 
shotdd  support  the  cooperative  nature  of  the  process. 
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6.4  Satisfying  and  Relaxing  Constraints:  The  Role  of  Negotiation 

An  integral  part  of  the  planning  process  is  the  ability  to  identify  and 
manage  constraints.  Constraints  drive  the  event-driven  replanning  process.  In 
part,  constraints  are  an  element  of  plaimers'  knowledge  of  their  tasks.  For 
instance,  whenever  planners  began  the  search  for  a  plane  to  divert,  they  also 
checked  on  an  appropriate  landing  site.  They  knew  the  constraints  of  their 
resources  and  naturally  folded  that  information  into  the  planning  process. 

Very  often  however,  new  information  comes  in  that  presents  additional 
constraints  that  planners  had  not  anticipate.  In  most  cases  the  disrupting  event 
and  subsequent  secondary  disruptions  are  accompanied  by  constraints  that 
planners  must  satisfy  in  order  to  implement  a  plan  successfully.  Planners  satisfy 
constraints  by  managing  them  or  by  relaxing  them.  Managing  constraints 
involves  finding  ways  to  deal  with  the  constraining  elements.  For  instance, 
searching  for  a  suitable  landing  field  is  a  way  to  manage  the  weight  constraints 
of  particular  aircraft  Relaxing  constraints,  on  the  other  hand,  involves  removing 
or  modifying  the  constraining  elements.  For  example,  in  Case  1,  waiving  the 
heart  monitor  requirement  removed  the  need  for  a  cardiac  attendant  In  Case  3, 
planners  considered  turning  the  monitoring  equipment  off  during  take-off  and 
landing  to  avoid  the  potentially  constraining  EMI  effects  during  critical  phases 
of  flight 

Negotiation  is  a  critical  and  necessary  component  of  constraint  relaxation 
and  the  overall  event-driven  replanning  process.  As  presented  in  Figure  7, 
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negotiation  plays  a  key  role  in  the  stepwise  approach  to  accommodate 
disrupting  events  and  institute  a  satisfactory  revised  plan.  In  addition, 
negotiation  is  an  inherently  cooperative  activity  that  requires  multilateral 
communications  between  participants  distributed  in  multiple  locations,  sharing 
and  exchanging  information  and  ideas.  The  cooperative  nature  of  negotiation  is 
the  result  of  information  that  resides  with  by  multiple  individuals  who  must 
coordinate  to  decide  and  act  to  carry  out  the  event-driven  replaiming  process. 

6.4.1  Strengths 

The  planners'  abdity  to  manage  and  relax  constraints  via  negotiation  is  a 
major  strength  in  his/her  ability  to  perform  the  event-driven  replanning  process 
Knowledge  of  the  system  and  the  people  that  operate  within  the  system  enable 
plaimers  to  identify  the  flexible  boundaries  that  may  be  candidates  for 
negotiation.  Favors  owed  and  friends  in  key  places  contributed  to  the  planners' 
abilities  to  negotiate  constraints  and  devise  new  plans  in  the  cases  observed  in 
this  study. 

6.4.2  Weaknesses 

The  manual  approach  to  the  negotiation  process  may  be  difficxilt  to 
manage  when  there  are  multiple  constraints  or  tasks  to  deal  with  particularly 
during  scaled-up  operations.  In  addition,  the  inherently  cooperative  nature  of 
negotiation  is  susceptible  to  all  of  the  shortcomings  of  shared  tasks.  Since 
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negotiation  is  reliant  on  the  participants  ability  to  communicate,  disrupted  lines 
of  communication  can  create  major  bottlenecks  and  potential  fadtures  in  the 
negotiation  process. 

6.4.3  Supporting  Negotiation 

Supporting  negotiation  is  critical  to  effective  event-driven  replanning.  As 
such,  supporting  negotiation  is  inherently  a  process  of  supporting  cooperative 
work.  Tools  to  support  this  activity  must  be  very  flexible,  adaptable  and 
provide  mechanisms  that  allow  participants  to  identify  and  discuss  tradeoffs. 
Techniques  could  include;  identifying  constraints  that  have  flexible  boundaries, 
using  "fuzzy"  logic  that  would  enable  planners  to  have  flexible  control  of 
parameters,  and  generating  options  to  help  planners  stack  chits  to  use  in  the 
negotiation  process. 

6.5  Managing  vs.  Minimizing  Cascading  Secondary  Disruptions 

A  significant  amount  of  the  planning  activity  centered  around  handling 
secondary  disruptions  that  resulted  from  decisions  to  utilize  previously 
committed  resources.  Diverting  aircraft  that  were  part  of  a  plan  in  progress 
produced  side  effects  that  rippled  throughout  the  planning  process.  Not  only 
were  original  plans  disrupted,  but  plans  for  missions  days  into  the  future  also 
had  to  be  modified  in  order  to  accommodate  the  changes  required  to  satisfy  the 
unanticipated  event 
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Managing  secondary  disruptions  could  entail  switching  crews,  arranging 
new  equipment  requirements,  etc.  In  addition,  secondary  disruptions 
necessitate  additional  coordination,  bring  more  participants  into  the  process, 
widen  the  distribution  and  coordination  network,  and  ultimately  increase  the 
number  of  potential  failure  points  in  the  process.  Taking  into  accoxmt  aU  of  the 
additional  work  and  potential  problems  associated  with  managing  secondary 
disruptions,  it  was  assumed  that  planners  would  try  to  minimize  the  number  of 
secondary  disruptions.  Consequently,  the  initial  hypothesis  was  that  planners 
would  explicitly  considered  minimizing  number  of  secondary  disruptions  as 
they  sought  solutions  to  the  primary  disrupting  event  Surprisingly  however, 
observations  and  results  of  the  protocol  analysis  did  not  support  this  hypothesis. 
Potential  secondary  disruptions  were  not  explicitly  considered  as  part  of  the 
equation  for  determining  which  plane  to  divert  Instead,  planners  used 
primarily  a  depth  first  planning  strategy  to  satisfy  the  primary  disrupting  event 
opting  to  manage  the  secondary  disruptions  that  ensued.  This  approach  is  very 
similar  to  the  abstraction  hierarchy  plan  generation  process  described  by 
Sarcedoti  (1974).  Like  the  abstraction  hierarchy,  planners  identify  the  top  level 
plan  for  dealing  with  the  primary  disrupting  event  and  consider  the  secondary 
disruptions  as  details  to  be  handled  at  lower  stages  of  the  planning  process. 


119 


6.5.1  Strengths 

One  of  the  primary  reasons  why  planners  may  engage  in  this  seemingly 
inefficient  planning  approach  is  that  the  majority  of  the  primary  disrupting 
events  have  a  compelling  sense  of  urgency  attached  to  them.  When  a  patienf  s 
status  is  classified  as  Urgent,  it  means  deal  with  that  patient  AS  SOON  AS 
POSSIBLE ,  regardless  of  the  8  hour  time  window  specified  in  the  regulations. 
During  the  course  of  this  research,  there  were  several  instances  where  GPMRC 
could  not  provide  transportation  RIGHT  NOW.  In  cases  where  GPMRC  was 
unable  to  provide  immediate  transport  (typically  within  2  hours  maximum). 
Urgent  Patients  were  sent  to  local  civilian  hospitals  to  receive  the  appropriate 
medical  care.  As  a  result,  planners  focus  on  satisfying  the  new  demand 
exclusively  rather  than  seeking  solutions  that  will  inclusively  accommodate  the 
new  demand,  secondary  disruptions,  and  planner  workload.  Given  the  urgency 
of  many  of  the  imanticipated  disrupting  events,  this  is  in  fact  a  rational  approach 
under  the  circumstances. 

6.5.2  Weaknesses 

One  of  the  primary  weaknesses  with  this  approach  is  that  it  can  prove 
costly  when  secondary  disruptions  are  significant.  This  was  what  happened  in 
Case  2  when  a  secondary  disruption  proved  to  be  more  than  a  "detail"  to  be 
handled.  Consequently,  planners  were  forced  to  backtrack  and  revise  their  plan. 
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Another  potential  weakness  might  be  the  planners'  abilities  to  manage  a 
large  number  of  secondary  disruptions.  In  the  cases  observed,  planners  did  a 
fair  job  of  managing  secondary  disruptions;  however,  it  was  apparent  that  they 
were  indeed  challenged  by  the  small  scale  disruptions  that  were  encoimtered. 
Consequently,  if  one  or  two  disruptions  were  problematic,  what  woxild  happen 
in  a  mass  casualty  situation?  Obviously  planners  would  be  quickly 
overwhelmed  and  planning  would  suffer  as  a  result 

6.5.3  Supporting  the  Management  of  Secondary  Disruptions 

Planners  need  a  visualization  tool  that  would  allow  them  to  see  the 
spreading  effects  of  diverting  aircraft  and  changing  itineraries.  In  addition,  the 
availability  of  more  breadth  of  options  would  save  time  by  decreasing  the 
amotmt  of  backtracking  required  to  enact  a  viable  plan.  A  computer  could  be 
used  to  generate  options  that  satisfy  the  new  demand  exclusively  or  take  other 
factors  into  consideration,  such  as  minimizing  secondary  disruptions.  However, 
it  shotdd  be  noted  that  consideration  of  secondary  dismptions  may  only  be 
relevant  with  respect  to  anticipating  potential  impasses  as  a  means  to  identify 
constraints  and  highlight  those  areas  where  constraint  relaxation  and  negotiation 
may  occxu*.  and  not  minimizing  secondary  disruptions  despite  their  cost.  In  any 
case,  computer  generated  options  must  be  equally  satisfactory  with  regard  to 
accommodating  the  new  demand. 
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6.6  Collaborative  Projection 


There  was  evidence  that  planners  utilized  a  planning  preview  process 
much  like  a  visualization  tool  that  will  be  referred  to  as  "collaborative 
projection"  during  each  of  the  cases  observed.  Collaborative  projection  occurred 
as  planners  tried  to  determine  the  activities  required  and  the  potential 
bottlenecks  to  overcome  in  accommodating  the  primary  disrupting  event 
(planners  did  not  look  ahead  in  order  to  minimize  the  cascade  of  secondary 
disruptions).  Collaborative  projection  was  used  to  step  through  certain  aspects 
of  the  proposed  plan  much  like  Klein' s  mental  simulation.  Dining  mental 
simulation,  an  individual  consciously  enacts  a  sequence  of  events  in  an  attempt 
to  envision  how  a  situation  will  evolve  (Klein  &  Crandall,  1995).  Like  mental 
simulation,  collaborative  projection  was  used  to  develop  expectancies  and  detect 
potential  bottlenecks.  The  primary  distinguishing  factor  between  mental 
simulation  and  collaborative  projection  however,  is  that  while  mental  simulation 
is  a  process  that  occms  in  the  mind  of  an  individual,  collaborative  projection  is 
an  activity  that  is  distributed  across  individuals  as  they  simulate  portions  of  a 
plan  and  then  collectively  construct  the  overall  proposed  plan  sequence.  Each 
member  of  the  team  walked  through  the  steps  their  particular  areas  of 
responsibilities  to  determine  requirements  and  anticipate  bottlenecks.  For 
instance,  the  FCC  projected  aspects  of  the  plan  related  to  patient  care  and 
supporting  the  MCD.  The  DO  projected  mission  requirements  such  as  crew 
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duty  time,  landing  requirements,  clearing  customs,  etc.  The  CTL  simtdated 
coordinating  with  the  various  AECs  and  ground  transportation  requirements. 
The  CP  projected  the  flight  calculations  and  clearances  required  and  the 
information  that  would  have  to  be  passed  on  to  the  flight  crew.  Each  team 
member  knew  their  area  of  responsibility  and  consequently  engaged  in  mental 
simulation  to  walk  through  the  details  of  their  portions  of  the  plan. 

Whenever  a  team  member  encountered  an  potential  bottleneck  or 
situation  that  needed  further  attention,  this  information  was  shared  with  the 
group  so  that  a  solution  could  be  determined  or  others  could  adjust  their 
prospective  mental  pictures  to  incorporate  this  new  information. 

6.6.1  Strengths 

The  socially  distributed  cognitive  nature  of  collaborative  projection 
produces  plans  that  are  more  robust  than  those  created  by  individuals.  The 
distributed  simulation  process  provides  multiple  perspectives  of  the  problem 
space  and  lessens  the  probability  that  data  will  be  missed  or  relevant 
information  left  out.  Having  multiple  perspectives  also  guards  against  potential 
fixation  errors  (DeKeyser  &  Woods,  1990). 

6.6.2  Weaknesses 

Since  this  is  a  collective  process,  if  one  team  member's  projection  (i.e.  then- 
assessment  and  simulation  of  their  respective  area)  is  in  error,  they  can  affect 
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everyone  else's  image  and  ultimately  distort  the  replanning  process  if  the  error 
goes  xmdetected.  For  example,  if  a  controller  projects  an  image  in  which  he  has 
coordinated  ground  transportation  for  a  particular  time,  the  FCC  and  the  DO 
will  respond  to  that  information  and  project  coordination  with  the  flight  crew, 
AEC,  and  medical  crews  for  that  time.  If  the  controller  errs  with  respect  to  the 
projected  transportation  time,  a  mismatch  would  exist  between  the  GPMRC's 
expectations  and  reality  an  a  plan-goal  mismatch  would  result  (Hammond, 
1991). 

6.6.3  Supporting  Collaborative  Projection 

A  tool  that  supports  collaborative  projection  must  be  able  to  respond  to 
multiple  inputs  to  maintain  the  socially  distributed  cognitive  process.  It  should 
provide  an  open  visualization  tool  that  will  allow  all  team  members  to  view  a 
composite  image  of  the  status  of  the  replanning  process  from  which  they  can 
modify  their  individual  projection  until  a  coherent  picture  emerges.  New 
information  will  cause  one  or  more  of  the  individual  projections  to  become 
unfocused  prompting  team  members  to  modify  or  re-tune  their  particular 
portion  of  the  replanning  activity  to  regain  the  coherent  common  image. 
Collaborative  projection  is  an  interesting  phenomenon  that  warrants  further 
study  to  explore  in  depth  how  it  is  carried  out  and  how  to  enhance  this 
seemingly  naturally  occurring  process. 
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6.7  Conclusion 


Event-driven  replanning  is  much  more  complex  than  simple  plan 
generation  or  static  plan  repair.  Event-driven  replanning  is  dynamic  -  resources 
are  committed,  wheels  are  turning,  people  are  moving,  and  planes  are  flying.  It 
is  a  multifaceted  process  that  requires  the  ability  to  solve  problems,  manage 
disruptions,  and  make  decisions  to  accompUsh  the  task.  The  aeromedical 
evacuation  is  an  environment  that  compounds  the  complexity  of  the  process 
because  it,  like  many  other  complex  scheduling  and  planning  processes,  is 
physically  and  functionally  distributed  across  multiple  participants. 

The  cases  observed  during  this  study  provided  a  natural  laboratory  to 
study  the  cognitive  issues  involved  in  military  aeromedical  evacuation  planning. 

In  order  to  support  the  event-driven  replanning  process,  tools  must  be 
designed  to  augment  the  plaimer's  ability  to  manage  multiple  issues  that  arise 
during  the  planning  and  replanning  process.  In  addition,  any  such  tool  must 
provide  adequate  flexibility  to  allow  tradeoffs  and  negotiations  to  take  place. 
Only  if  these  activities  are  supported  can  computer  tools  in  this  environment 
expect  to  succeed  as  decision  making  aides.  It  is  hoped  that  the  information 
obtained  in  this  research  can  be  used  to  design  more  effective  automated  tools  to 
support  the  complex  event-driven  replanning  process.  Supporting  event-driven 
replanning  is  much  more  than  simply  designing  complex  scheduling  algorithms, 
automated  solution  generators,  or  computer  tools  to  support  a  single  individual. 
It's  about  designing  tools  to  support  the  inherently  cooperative  nature  of  key 
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aspects  of  the  event-driven  replanning  process.  It's  about  computer  supported 
collaborative  work  (CSCW).  Studying  the  event-driven  replaiming  process  in 
the  current  aeromedical  evacuation  system  indicates  that  perhaps  the  smartest 
approach  to  aiding  the  replaiming  process  may  come  through  CSCW)  tools. 
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